00000100:00100000:2.0:1786174348.158397:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145074816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174348.158415:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174348.158419:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174348.158423:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145074816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174348.158430:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145074944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174348.158448:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174348.158458:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174348/real 1786174348]  req@ffff89d9ba2ff100 x1872931145074944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174348.158472:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145074944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174348.158482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174348.158486:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174348.158489:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145074944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174348.158496:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145075072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174348.158514:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174348.158524:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174348/real 1786174348]  req@ffff89d9ba2ff800 x1872931145075072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174348.158538:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145075072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174348.158548:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174348.158551:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174348.158556:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145075072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174349.181051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174350.205051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174351.229053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174352.253050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174353.277123:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174353.277313:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145075200:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174353.277436:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.277507:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe65180 x1872931145075200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.277554:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145075200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.277579:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.277588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.277601:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145075200:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174353.277640:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145075328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174353.277689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.277710:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe67800 x1872931145075328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.277737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145075328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.277760:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.277764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.277774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145075328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174353.277787:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145075456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174353.277823:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.277841:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe65500 x1872931145075456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.277873:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145075456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.277951:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.277958:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.277966:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145075456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174353.277983:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145075584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174353.278028:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.278067:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe66d80 x1872931145075584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.278115:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145075584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.278130:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.278135:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.278146:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145075584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174353.278207:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145075712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174353.278271:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.278291:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe66680 x1872931145075712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.278349:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145075712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.278359:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.278364:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.278370:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145075712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174353.278378:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145075840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174353.278397:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.278406:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe66a00 x1872931145075840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.278418:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145075840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.278426:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.278428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.278431:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145075840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174353.278437:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145075968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174353.278452:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.278461:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe67b80 x1872931145075968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.278472:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145075968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.278481:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.278484:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.278488:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145075968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174353.278493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145076096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174353.278508:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.278517:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe64380 x1872931145076096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.278527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145076096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.278535:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.278538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.278541:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145076096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174353.278557:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145076224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174353.278574:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174353.278583:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174353/real 1786174353]  req@ffff89d99fe66d80 x1872931145076224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174353.278595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145076224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174353.278603:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174353.278605:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174353.278610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145076224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174358.397175:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145076352:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174358.397257:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.397307:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe65500 x1872931145076352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.397335:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145076352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.397365:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.397377:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.397388:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145076352:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174358.397434:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145076480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174358.397472:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.397491:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe67800 x1872931145076480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.397525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145076480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.397559:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.397572:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.397583:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145076480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174358.397595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145076608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174358.397628:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.397650:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe65180 x1872931145076608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.397676:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145076608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.397708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.397717:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.397728:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145076608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174358.397744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145076736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174358.397778:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.397795:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe66300 x1872931145076736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.397810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145076736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.397820:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.397841:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.397845:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145076736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174358.397851:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145076864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174358.397867:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.397888:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe65880 x1872931145076864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.397936:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145076864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.397950:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.397955:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.397961:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145076864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174358.397987:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145076992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174358.398036:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.398048:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe65f80 x1872931145076992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.398060:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145076992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.398068:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.398071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.398074:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145076992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174358.398080:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145077120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174358.398095:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.398103:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe67100 x1872931145077120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.398114:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145077120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.398121:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.398124:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.398127:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145077120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174358.398132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145077248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174358.398146:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.398154:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe67480 x1872931145077248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.398163:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145077248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.398170:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.398173:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.398176:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145077248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174358.398181:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145077376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174358.398213:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174358.398222:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174358/real 1786174358]  req@ffff89d99fe64700 x1872931145077376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174358.398233:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145077376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174358.398241:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174358.398244:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174358.398247:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145077376:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786174363.517092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.517108:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174363.517118:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.517143:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.517164:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.517182:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174363.517259:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145077504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174363.517311:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.517319:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174363.517323:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.517333:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.517343:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.517353:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174363.517375:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174363.517413:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145077632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174363.517432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.517438:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174363.517440:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.517446:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.517453:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.517460:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174363.517466:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174363.517483:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145077760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174363.517535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.517542:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174363.517544:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.517551:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.517557:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.517562:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174363.517571:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174363.517594:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145077888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174363.517626:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.517634:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174363.517642:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.517677:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.517695:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.517711:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174363.517722:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174363.517751:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145078016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174363.517771:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.517782:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174363.517788:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.517798:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.517806:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.517819:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174363.517837:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174363.517860:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145078144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174363.518016:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.518024:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174363.518031:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.518044:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.518050:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.518056:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174363.518066:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174363.518094:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145078272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174363.518114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.518121:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174363.518125:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.518140:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.518158:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.518176:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174363.518197:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174363.518229:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145078400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174363.518268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174363.518274:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174363.518283:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174363.518298:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8097
00000100:00080000:2.0:1786174363.518309:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174363.518329:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174363.518346:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174363.518386:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145078528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174368.637279:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145078656:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174368.637404:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.637484:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe64000 x1872931145078656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.637535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145078656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.637560:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.637570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.637580:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145078656:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174368.637621:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145078784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174368.637683:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.637726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe64a80 x1872931145078784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.637755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145078784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.637771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.637778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.637785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145078784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174368.637794:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145078912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174368.637828:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.637843:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe64700 x1872931145078912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.637860:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145078912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.637870:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.637874:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.637880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145078912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174368.637980:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145079040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174368.638035:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.638067:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe67480 x1872931145079040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.638095:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145079040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.638135:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.638150:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.638163:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145079040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174368.638195:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145079168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174368.638248:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.638295:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe67100 x1872931145079168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.638358:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145079168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.638411:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.638425:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.638459:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145079168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174368.638493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145079296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174368.638576:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.638608:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe65f80 x1872931145079296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.638636:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145079296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.638649:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.638654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.638660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145079296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174368.638672:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145079424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174368.638697:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.638708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe65880 x1872931145079424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.638721:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145079424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.638730:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.638733:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.638736:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145079424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174368.638751:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145079552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174368.638770:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.638780:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe66300 x1872931145079552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.638793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145079552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.638802:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.638805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.638808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145079552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174368.638815:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145079680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174368.638832:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174368.638842:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174368/real 1786174368]  req@ffff89d99fe65180 x1872931145079680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174368.638855:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145079680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174368.638865:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174368.638867:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174368.638871:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145079680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174373.757140:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174373.757221:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145079808:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174373.757327:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.757388:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe67800 x1872931145079808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.757418:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145079808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.757439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.757447:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.757454:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145079808:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174373.757489:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145079936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174373.757531:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.757555:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe65500 x1872931145079936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.757579:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145079936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.757613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.757620:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.757627:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145079936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174373.757640:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145080064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174373.757677:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.757698:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe66d80 x1872931145080064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.757722:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145080064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.757740:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.757747:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.757754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145080064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174373.757766:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145080192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174373.757799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.757819:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe64380 x1872931145080192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.757842:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145080192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.757888:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.757936:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.757945:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145080192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174373.757981:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145080320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174373.758025:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.758061:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe67b80 x1872931145080320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.758087:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145080320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.758104:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.758121:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.758125:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145080320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174373.758134:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145080448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174373.758164:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.758179:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe66a00 x1872931145080448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.758205:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145080448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.758215:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.758219:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.758223:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145080448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174373.758229:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145080576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174373.758247:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.758259:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe66680 x1872931145080576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.758272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145080576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.758282:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.758285:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.758289:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145080576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174373.758295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145080704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174373.758313:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.758325:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe67800 x1872931145080704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.758339:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145080704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.758349:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.758352:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.758355:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145080704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174373.758361:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145080832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174373.758379:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174373.758389:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174373/real 1786174373]  req@ffff89d99fe65180 x1872931145080832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174373.758402:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145080832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174373.758413:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174373.758417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174373.758421:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145080832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174374.781054:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174375.805036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174376.829038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174377.853063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174378.877084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174378.877105:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877122:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.877136:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.877150:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174378.877205:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145080960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174378.877249:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877256:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174378.877260:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877268:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.877276:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.877285:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174378.877301:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174378.877331:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145081088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174378.877348:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877353:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174378.877356:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877362:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.877368:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.877372:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174378.877379:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174378.877400:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145081216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174378.877419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877424:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174378.877427:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877433:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.877436:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.877440:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174378.877447:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174378.877468:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145081344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174378.877522:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877529:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174378.877531:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877538:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.877543:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.877551:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174378.877556:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174378.877576:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145081472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174378.877619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877627:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174378.877633:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877642:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.877647:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.877652:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174378.877658:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174378.877676:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145081600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174378.877689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174378.877699:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877703:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.877708:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.877712:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174378.877719:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174378.877736:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145081728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174378.877765:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877771:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174378.877777:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877791:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.877841:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.877856:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174378.877863:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174378.877888:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145081856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174378.877958:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174378.877974:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174378.877979:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174378.877993:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8113
00000100:00080000:2.0:1786174378.878009:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174378.878026:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174378.878040:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174378.878076:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145081984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237110:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237123:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174394.237130:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237145:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.237161:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.237173:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174394.237222:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145084416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237269:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174394.237273:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237281:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.237289:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.237298:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174394.237316:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174394.237353:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145084544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237376:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174394.237379:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237385:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.237391:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.237396:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174394.237403:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174394.237420:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145084672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237437:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174394.237440:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237460:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.237467:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.237477:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174394.237494:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174394.237513:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145084800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237533:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174394.237536:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237542:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.237547:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.237556:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174394.237567:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174394.237587:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145084928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237600:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237614:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174394.237619:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237626:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.237633:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.237638:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174394.237669:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174394.237696:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145085056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174394.237734:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237750:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.237758:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.237764:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174394.237774:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174394.237799:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145085184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237819:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237824:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174394.237827:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237833:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.237839:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.237844:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174394.237852:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174394.237875:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145085312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174394.237890:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174394.237894:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174394.237968:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174394.237996:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8128
00000100:00080000:2.0:1786174394.238007:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174394.238015:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174394.238027:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174394.238053:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145085440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174397.309674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87f100 x1872931145085440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.309723:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145085440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.309757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.309771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.309785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145085440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174397.309807:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87d880 x1872931145085056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.309855:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145085056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.309880:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.309886:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.309892:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145085056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174397.309936:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87d500 x1872931145084928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.309956:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145084928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.309971:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.309978:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.309984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145084928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174397.309996:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87e680 x1872931145084800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.310016:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145084800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.310029:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.310034:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.310039:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145084800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174397.310049:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87c380 x1872931145084544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.310068:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145084544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.310080:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.310086:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.310091:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145084544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174397.310101:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87c700 x1872931145084672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.310121:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145084672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.310133:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.310139:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.310144:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145084672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174397.310154:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87df80 x1872931145084416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.310173:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145084416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.310195:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.310200:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.310206:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145084416:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174397.310250:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87ca80 x1872931145085312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.310268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145085312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.310282:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.310286:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.310290:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145085312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174397.310299:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174394/real 1786174397]  req@ffff89d99e87f800 x1872931145085184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174397.310317:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145085184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174397.310326:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174397.310330:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174397.310335:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145085184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174399.357437:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145085568:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174399.357555:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.357669:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe65180 x1872931145085568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.357721:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145085568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.357754:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.357768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.357783:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145085568:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174399.357851:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145085696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174399.357977:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.358015:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe67800 x1872931145085696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.358068:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145085696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.358149:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.358166:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.358184:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145085696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174399.358211:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145085824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174399.358276:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.358310:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe66680 x1872931145085824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.358363:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145085824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.358394:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.358409:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.358418:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145085824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174399.358431:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145085952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174399.358471:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.358493:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe66a00 x1872931145085952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.358516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145085952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.358531:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.358537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.358545:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145085952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174399.358576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145086080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174399.358644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.358667:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe67b80 x1872931145086080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.358691:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145086080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.358707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.358713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.358719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145086080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174399.358731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145086208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174399.358768:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.358790:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe64380 x1872931145086208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.358815:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145086208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.358831:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.358850:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.358864:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145086208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174399.358882:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145086336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174399.358965:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.358989:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe66d80 x1872931145086336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.359013:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145086336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.359030:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.359036:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.359043:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145086336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174399.359055:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145086464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174399.359090:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.359112:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe65500 x1872931145086464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.359133:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145086464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.359147:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.359154:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.359159:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145086464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174399.359191:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145086592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174399.359230:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174399.359252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174399/real 1786174399]  req@ffff89d99fe65180 x1872931145086592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174399.359276:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145086592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174399.359292:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174399.359299:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174399.359305:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145086592:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786174414.717104:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.717143:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174414.717150:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.717161:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.717174:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.717183:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174414.717233:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145089024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174414.717296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.717303:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174414.717307:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.717315:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.717323:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.717332:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174414.717349:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174414.717404:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145089152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174414.717424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.717429:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174414.717433:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.717439:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.717510:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.717520:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174414.717530:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174414.717562:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145089280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174414.717583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.717590:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174414.717594:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.717602:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.717611:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.717624:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174414.717636:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174414.717661:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145089408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174414.717679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.717695:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174414.717702:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.717718:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.717728:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.717744:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174414.717761:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174414.717804:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145089536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174414.717841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.717847:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174414.717850:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.717859:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.717867:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.717881:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174414.717892:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174414.717960:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145089664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174414.717978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.717991:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174414.718017:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.718030:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.718039:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.718055:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174414.718071:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174414.718106:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145089792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174414.718122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.718127:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174414.718146:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.718157:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.718168:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.718179:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174414.718188:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174414.718211:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145089920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174414.718292:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174414.718302:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174414.718310:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174414.718331:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8148
00000100:00080000:2.0:1786174414.718342:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174414.718374:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174414.718390:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174414.718418:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145090048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.956995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957001:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174424.957006:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957017:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957027:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957034:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174424.957065:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145091328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.957087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957092:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174424.957104:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957109:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957113:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957117:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174424.957126:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174424.957139:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145091456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.957148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957151:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174424.957153:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957157:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957160:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957163:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174424.957167:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174424.957176:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145091584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.957184:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957187:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174424.957189:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957192:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957195:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957199:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174424.957204:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174424.957213:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145091712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.957221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957224:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174424.957226:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957230:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957233:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957237:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174424.957241:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174424.957249:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145091840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.957258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957261:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174424.957263:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957266:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957270:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957273:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174424.957285:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174424.957293:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145091968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.957330:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957333:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174424.957335:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957340:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957343:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957347:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174424.957367:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174424.957404:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145092096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.957414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957418:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174424.957419:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957424:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957427:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957431:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174424.957435:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174424.957443:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145092224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174424.957453:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174424.957457:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174424.957459:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174424.957462:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8159
00000100:00080000:2.0:1786174424.957466:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174424.957470:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174424.957474:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174424.957485:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145092352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174430.076995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174430.077133:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145092480:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174430.077201:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.077240:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2fe680 x1872931145092480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.077263:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145092480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.077279:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.077285:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.077290:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145092480:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174430.077339:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145092608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174430.077402:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.077430:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2fd180 x1872931145092608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.077480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145092608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.077513:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.077522:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.077530:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145092608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174430.077541:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145092736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174430.077607:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.077650:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2ff800 x1872931145092736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.077711:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145092736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.077733:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.077741:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.077747:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145092736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174430.077767:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145092864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174430.077797:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.077813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2ff100 x1872931145092864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.077843:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145092864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.077863:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.077873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.077880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145092864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174430.077915:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145092992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174430.077941:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.077955:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2fdf80 x1872931145092992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.077983:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145092992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.077990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.077992:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.077995:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145092992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174430.078001:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145093120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174430.078029:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.078045:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2ffb80 x1872931145093120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.078062:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145093120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.078068:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.078071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.078073:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145093120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174430.078085:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145093248:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174430.078102:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.078110:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2fe300 x1872931145093248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.078118:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145093248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.078129:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.078131:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.078133:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145093248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174430.078137:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145093376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174430.078148:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.078155:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2fd500 x1872931145093376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.078163:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145093376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.078169:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.078171:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.078173:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145093376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174430.078177:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145093504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174430.078187:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174430.078194:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174430/real 1786174430]  req@ffff89d9ba2fea00 x1872931145093504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174430.078202:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145093504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174455 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174430.078208:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174430.078209:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174430.078212:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145093504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174431.101071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174432.124993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174435.197226:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145093632:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174435.197365:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.197425:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe65180 x1872931145093632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.197449:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145093632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.197469:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.197477:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.197484:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145093632:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174435.197515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145093760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174435.197542:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.197553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe67800 x1872931145093760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.197564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145093760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.197572:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.197574:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.197577:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145093760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174435.197582:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145093888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174435.197598:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.197606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe66680 x1872931145093888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.197616:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145093888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.197623:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.197625:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.197628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145093888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174435.197657:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145094016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174435.197671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.197679:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe66a00 x1872931145094016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.197689:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145094016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.197695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.197698:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.197700:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145094016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174435.197705:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145094144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174435.197719:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.197726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe67b80 x1872931145094144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.197743:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145094144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.197749:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.197751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.197754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145094144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174435.197758:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145094272:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174435.197771:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.197779:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe64380 x1872931145094272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.197788:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145094272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.197794:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.197796:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.197799:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145094272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174435.197803:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145094400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174435.197816:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.197823:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe66d80 x1872931145094400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.197832:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145094400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.197845:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.197848:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.197851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145094400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174435.197855:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145094528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174435.197869:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.197892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe65500 x1872931145094528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.197904:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145094528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.197913:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.197916:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.197920:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145094528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174435.197927:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145094656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174435.198001:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174435.198028:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174435/real 1786174435]  req@ffff89d99fe66300 x1872931145094656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174435.198040:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145094656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174435.198047:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174435.198050:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174435.198054:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145094656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174440.317275:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145094784:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174440.317417:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.317493:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe64000 x1872931145094784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.317527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145094784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.317572:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.317584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.317595:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145094784:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174440.317615:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145094912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174440.317650:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.317664:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe64a80 x1872931145094912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.317676:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145094912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.317688:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.317692:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.317695:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145094912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174440.317758:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145095040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174440.317798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.317816:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe64700 x1872931145095040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.317830:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145095040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.317843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.317848:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.317856:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145095040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174440.317869:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145095168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174440.317901:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.317939:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe67480 x1872931145095168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.318011:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145095168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.318022:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.318027:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.318036:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145095168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174440.318045:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145095296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174440.318077:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.318096:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe67100 x1872931145095296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.318113:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145095296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.318129:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.318136:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.318145:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145095296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174440.318154:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145095424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174440.318188:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.318233:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe65f80 x1872931145095424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.318246:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145095424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.318256:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.318261:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.318265:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145095424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174440.318272:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145095552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174440.318301:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.318314:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe65880 x1872931145095552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.318325:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145095552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.318332:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.318335:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.318339:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145095552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174440.318347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145095680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174440.318382:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.318395:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe66300 x1872931145095680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.318408:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145095680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.318415:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.318418:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.318423:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145095680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174440.318430:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145095808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174440.318450:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174440.318467:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174440/real 1786174440]  req@ffff89d99fe65500 x1872931145095808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174440.318482:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145095808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174440.318490:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174440.318492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174440.318495:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145095808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174445.437164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145095936:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174445.437257:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437324:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe66d80 x1872931145095936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437402:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145095936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437433:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437446:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437459:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145095936:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174445.437517:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145096064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174445.437574:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe64380 x1872931145096064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145096064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437621:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437625:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145096064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174445.437631:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145096192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174445.437646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437654:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe67b80 x1872931145096192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437662:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145096192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145096192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174445.437683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145096320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174445.437694:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437701:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe66a00 x1872931145096320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145096320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437724:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437726:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145096320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174445.437731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145096448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174445.437743:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe66680 x1872931145096448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437758:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145096448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437763:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437765:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437767:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145096448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174445.437772:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145096576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174445.437783:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437789:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe67800 x1872931145096576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437796:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145096576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437802:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437804:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437806:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145096576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174445.437809:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145096704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174445.437820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437825:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe65180 x1872931145096704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437833:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145096704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437840:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437842:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145096704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174445.437857:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145096832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174445.437868:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe66d80 x1872931145096832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437883:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145096832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437889:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437890:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437892:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145096832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174445.437937:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145096960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174445.437952:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174445.437960:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174445/real 1786174445]  req@ffff89d99fe65500 x1872931145096960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174445.437968:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145096960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174445.437974:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174445.437976:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174445.437978:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145096960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174449.533102:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174450.557028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174450.557213:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145097088:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174450.557285:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.557345:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe66300 x1872931145097088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.557462:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145097088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.557503:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.557510:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.557521:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145097088:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174450.557553:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145097216:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174450.557588:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.557610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe65880 x1872931145097216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.557630:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145097216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.557656:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.557665:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.557674:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145097216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174450.557689:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145097344:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174450.557787:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.557807:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe65f80 x1872931145097344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.557853:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145097344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.557883:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.557891:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.557899:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145097344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174450.557910:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145097472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174450.557970:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.557993:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe67100 x1872931145097472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.558007:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145097472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.558014:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.558017:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.558020:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145097472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174450.558025:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145097600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174450.558045:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.558054:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe67480 x1872931145097600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.558063:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145097600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.558069:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.558072:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.558075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145097600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174450.558091:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145097728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174450.558131:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.558142:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe64700 x1872931145097728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.558153:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145097728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.558159:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.558162:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.558165:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145097728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174450.558170:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145097856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174450.558185:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.558193:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe64a80 x1872931145097856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.558202:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145097856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.558209:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.558211:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.558213:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145097856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174450.558218:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145097984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174450.558230:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.558237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe64000 x1872931145097984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.558247:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145097984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.558254:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.558256:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.558258:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145097984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174450.558263:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145098112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174450.558275:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174450.558287:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174450/real 1786174450]  req@ffff89d99fe66300 x1872931145098112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174450.558303:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145098112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174450.558315:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174450.558319:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174450.558324:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145098112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174451.581078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174452.604971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174453.629051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174455.677247:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145098240:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174455.677357:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.677401:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe65500 x1872931145098240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.677446:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145098240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.677460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.677469:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.677477:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145098240:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174455.677504:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145098368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174455.677542:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.677560:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe66d80 x1872931145098368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.677581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145098368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.677595:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.677601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.677605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145098368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174455.677619:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145098496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174455.677671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.677694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe65180 x1872931145098496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.677718:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145098496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.677745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.677773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.677779:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145098496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174455.677786:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145098624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174455.677804:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.677811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe67800 x1872931145098624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.677840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145098624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.677849:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.677852:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.677856:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145098624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174455.677862:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145098752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174455.677881:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.677892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe66680 x1872931145098752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.677905:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145098752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.677913:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.677916:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.677921:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145098752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174455.677927:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145098880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174455.677995:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.678005:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe66a00 x1872931145098880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.678013:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145098880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.678019:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.678021:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.678023:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145098880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174455.678037:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145099008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174455.678067:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.678076:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe67b80 x1872931145099008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.678106:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145099008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.678116:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.678119:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.678123:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145099008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174455.678130:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145099136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174455.678152:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.678164:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe64380 x1872931145099136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.678177:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145099136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.678186:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.678189:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.678192:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145099136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174455.678199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145099264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174455.678231:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174455.678237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174455/real 1786174455]  req@ffff89d99fe65500 x1872931145099264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174455.678245:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145099264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174455.678251:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174455.678253:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174455.678255:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145099264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174460.797227:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145099392:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174460.797367:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145099520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174460.797423:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145099648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174460.797471:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145099776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174460.797503:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145099904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174460.797546:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145100032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174460.797576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145100160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174460.797592:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145100288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174460.797605:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145100416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174463.869563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe65500 x1872931145100416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.869602:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145100416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.869619:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.869625:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.869631:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145100416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174463.869640:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe64a80 x1872931145099648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.869656:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145099648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.869666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.869670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.869692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145099648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174463.869703:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe64700 x1872931145099776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.869716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145099776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.869725:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.869728:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.869732:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145099776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174463.869738:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe67480 x1872931145099904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.869756:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145099904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.869769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.869798:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.869804:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145099904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174463.869815:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe67100 x1872931145100032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.869838:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145100032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.869853:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.869859:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.869865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145100032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174463.869877:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe66300 x1872931145099392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.869947:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145099392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.869964:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.869971:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.870005:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145099392:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174463.870018:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe64000 x1872931145099520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.870046:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145099520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.870062:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.870069:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.870075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145099520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174463.870132:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe65f80 x1872931145100160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.870159:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145100160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.870176:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.870184:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.870191:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145100160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174463.870205:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174460/real 1786174463]  req@ffff89d99fe65880 x1872931145100288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174463.870239:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145100288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174463.870254:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174463.870260:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174463.870267:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145100288:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786174465.917106:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917113:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174465.917117:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917126:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917135:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917145:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174465.917191:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145100544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174465.917226:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917231:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174465.917233:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917237:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917241:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917245:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174465.917254:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174465.917269:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145100672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174465.917283:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917287:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174465.917288:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917292:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917295:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917298:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174465.917301:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174465.917312:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145100800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174465.917337:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917341:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174465.917343:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917348:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917353:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917358:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174465.917369:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174465.917389:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145100928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174465.917402:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917407:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174465.917409:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917417:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917434:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917442:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174465.917451:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174465.917478:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145101056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174465.917515:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917520:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174465.917523:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917528:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917533:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917540:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174465.917546:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174465.917560:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145101184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174465.917575:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917580:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174465.917583:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917607:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917617:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917623:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174465.917629:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174465.917647:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145101312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174465.917693:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917703:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174465.917709:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917721:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917729:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917738:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174465.917745:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174465.917764:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145101440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174465.917784:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174465.917794:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174465.917797:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174465.917806:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8200
00000100:00080000:2.0:1786174465.917815:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174465.917823:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174465.917833:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174465.917854:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145101568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037057:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037068:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174471.037074:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037087:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037097:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037105:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174471.037141:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145101696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037167:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037171:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174471.037173:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037176:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037178:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037183:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174471.037192:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174471.037203:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145101824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037215:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037218:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174471.037219:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037223:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037225:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037227:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174471.037231:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174471.037240:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145101952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037250:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037254:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174471.037255:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037259:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037263:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037267:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174471.037270:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174471.037281:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145102080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037289:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037291:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174471.037293:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037296:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037299:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037301:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174471.037304:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174471.037311:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145102208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037317:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037320:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174471.037321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037334:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037341:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037348:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174471.037353:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174471.037364:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145102336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037382:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037387:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174471.037391:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037400:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037406:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037409:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174471.037413:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174471.037438:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145102464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037450:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037454:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174471.037456:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037461:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037464:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037468:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174471.037472:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174471.037484:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145102592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174471.037494:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174471.037503:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174471.037508:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174471.037541:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8205
00000100:00080000:2.0:1786174471.037546:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174471.037554:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174471.037565:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174471.037585:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145102720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.157050:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.157064:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174476.157070:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.157092:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.157107:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.157117:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174476.157164:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145102848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.157201:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.157206:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174476.157209:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.157213:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.157218:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.157223:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174476.157234:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174476.157252:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145102976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.157305:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.157308:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174476.157310:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.157332:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.157337:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.157342:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174476.157350:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174476.157373:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145103104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.157386:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.157390:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174476.157392:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.157396:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.157401:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.157405:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174476.157412:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174476.157425:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145103232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.157459:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.157466:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174476.157469:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.157476:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.157484:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.157490:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174476.157496:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174476.157511:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145103360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.157522:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.157526:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174476.157529:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.157538:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.157544:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.157550:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174476.157556:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174476.157571:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145103488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.157685:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.157691:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174476.157693:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.157702:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.157713:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.157732:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174476.157753:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174476.157776:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145103616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.157845:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.157879:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174476.157948:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.157961:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.157970:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.157980:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174476.157996:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174476.158026:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145103744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174476.158072:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174476.158107:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174476.158119:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174476.158136:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8210
00000100:00080000:2.0:1786174476.158147:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174476.158159:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174476.158184:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174476.158206:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145103872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277003:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277012:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174481.277017:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277027:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277038:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277045:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174481.277091:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145104000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277115:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174481.277126:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277130:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277133:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277147:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174481.277154:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174481.277165:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145104128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277175:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277177:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174481.277178:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277181:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277184:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277186:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174481.277189:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174481.277197:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145104256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277207:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174481.277208:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277214:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277220:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277225:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174481.277230:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174481.277244:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145104384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277272:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277282:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174481.277285:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277289:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277293:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277300:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174481.277308:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174481.277323:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145104512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277346:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174481.277348:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277355:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277363:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277369:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174481.277376:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174481.277391:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145104640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277418:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174481.277421:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277427:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277433:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277440:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174481.277445:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174481.277458:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145104768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277467:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277472:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174481.277475:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277483:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277492:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277502:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174481.277512:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174481.277530:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145104896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174481.277544:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174481.277547:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174481.277552:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174481.277558:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8215
00000100:00080000:2.0:1786174481.277561:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174481.277567:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174481.277575:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174481.277586:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145105024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.396989:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.396998:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174486.397001:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397021:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397029:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397040:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174486.397075:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145105152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.397106:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.397111:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174486.397112:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397117:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397123:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397129:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174486.397139:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174486.397159:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145105280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.397189:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.397192:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174486.397194:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397198:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397201:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397204:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174486.397208:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174486.397217:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145105408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.397224:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.397227:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174486.397229:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397233:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397237:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397239:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174486.397244:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174486.397250:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145105536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.397256:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.397259:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174486.397260:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397262:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397265:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397274:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174486.397284:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174486.397303:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145105664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.397312:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.397315:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174486.397317:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397320:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397324:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397327:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174486.397330:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174486.397337:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145105792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.397343:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.397345:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174486.397346:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397349:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397351:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397353:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174486.397356:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174486.397364:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145105920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.397389:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.397404:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174486.397410:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397416:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397419:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397422:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174486.397427:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174486.397442:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145106048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174486.397453:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174486.397462:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174486.397469:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174486.397477:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8220
00000100:00080000:2.0:1786174486.397489:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174486.397493:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174486.397497:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174486.397507:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145106176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637082:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174496.637088:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637117:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637130:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637138:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174496.637186:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145107456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637222:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637226:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174496.637227:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637231:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637233:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637236:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174496.637247:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174496.637257:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145107584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637270:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174496.637272:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637276:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637278:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637283:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174496.637288:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174496.637303:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145107712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637311:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637315:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174496.637317:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637319:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637322:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637325:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174496.637329:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174496.637339:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145107840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637346:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174496.637350:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637354:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637357:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637360:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174496.637363:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174496.637374:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145107968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637392:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174496.637394:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637399:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637404:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637411:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174496.637419:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174496.637438:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145108096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637455:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637461:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174496.637463:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637471:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637480:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637489:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174496.637516:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174496.637535:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145108224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637553:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174496.637557:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637563:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637568:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637576:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174496.637588:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174496.637604:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145108352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174496.637625:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174496.637635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174496.637640:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174496.637651:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8230
00000100:00080000:2.0:1786174496.637672:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174496.637678:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174496.637684:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174496.637696:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145108480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757032:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757040:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174501.757045:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757055:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757066:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757074:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174501.757116:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145108608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757147:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757151:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174501.757153:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757157:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757160:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757163:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174501.757173:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174501.757186:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145108736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757210:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757222:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174501.757226:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757234:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757240:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757246:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174501.757254:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174501.757275:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145108864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757299:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757304:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174501.757307:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757314:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757319:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757324:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174501.757332:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174501.757349:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145108992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757360:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757363:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174501.757368:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757374:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757379:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757386:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174501.757396:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174501.757414:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145109120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757436:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757448:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174501.757452:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757457:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757461:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757465:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174501.757469:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174501.757484:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145109248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757497:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757501:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174501.757503:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757512:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757517:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757524:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174501.757529:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174501.757544:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145109376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757583:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757589:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174501.757595:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757623:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757630:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757640:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174501.757649:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174501.757670:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145109504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174501.757687:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174501.757693:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174501.757695:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174501.757702:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8235
00000100:00080000:2.0:1786174501.757711:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174501.757720:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174501.757726:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174501.757742:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145109632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.877060:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.877071:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174506.877078:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.877091:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.877105:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.877116:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174506.877173:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145109760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.877223:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.877230:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174506.877233:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.877240:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.877248:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.877256:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174506.877270:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174506.877296:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145109888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.877314:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.877319:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174506.877321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.877327:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.877332:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.877337:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174506.877343:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174506.877359:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145110016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.877381:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.877388:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174506.877391:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.877399:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.877404:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.877408:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174506.877415:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174506.877428:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145110144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.877440:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.877444:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174506.877447:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.877458:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.877467:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.877487:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174506.877498:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174506.877527:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145110272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.877598:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.877605:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174506.877610:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.877623:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.877638:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.877647:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174506.877661:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174506.877698:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145110400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.877749:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.877765:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174506.877773:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.877785:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.877794:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.877806:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174506.877817:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174506.877843:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145110528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.877876:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.877891:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174506.877958:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.877975:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.877984:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.877992:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174506.878004:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174506.878033:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145110656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174506.878072:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174506.878090:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174506.878096:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174506.878111:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8241
00000100:00080000:2.0:1786174506.878126:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174506.878147:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174506.878169:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174506.878204:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145110784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174509.949091:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174511.997081:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174513.021084:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174514.045096:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174515.069153:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174516.093036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174517.117034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174518.141046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174519.165044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174520.189022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174521.212997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174522.237019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174523.261042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174524.285052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174525.309076:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174526.333090:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174527.357006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174527.357259:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145114368:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174527.357449:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145114496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174527.357551:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145114624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174527.357655:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145114752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174527.357739:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145114880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174527.357792:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145115008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174527.357866:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145115136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174527.357904:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145115264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174527.357931:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145115392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174528.381010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174529.405038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174530.428995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786174530.429195:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786174530.429232:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786174530.429246:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174530.429289:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786174530.429302:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174530.429311:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174530.429318:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174530.429327:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174530.429348:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174530.429359:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174530.429369:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786174531.453011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174547.837229:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145118976:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174547.837311:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.837384:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe65880 x1872931145118976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.837420:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145118976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.837431:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.837435:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.837439:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145118976:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174547.837466:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145119104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174547.837503:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.837523:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe67b80 x1872931145119104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.837536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145119104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.837544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.837547:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.837551:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145119104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174547.837557:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145119232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174547.837577:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.837589:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe66a00 x1872931145119232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.837601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145119232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.837615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.837623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.837631:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145119232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174547.837644:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145119360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174547.837686:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.837711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe66680 x1872931145119360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.837761:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145119360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.837781:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.837791:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.837819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145119360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174547.837857:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145119488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174547.837922:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.837940:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe67800 x1872931145119488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.838003:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145119488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.838014:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.838019:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.838024:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145119488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174547.838031:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145119616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174547.838075:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.838091:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe65180 x1872931145119616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.838106:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145119616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.838116:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.838120:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.838124:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145119616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174547.838131:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145119744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174547.838155:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.838206:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe66d80 x1872931145119744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.838228:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145119744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.838236:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.838240:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.838243:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145119744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174547.838250:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145119872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174547.838270:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.838283:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe64380 x1872931145119872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.838294:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145119872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.838302:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.838305:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.838309:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145119872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174547.838326:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145120000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174547.838346:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174547.838358:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174547/real 1786174547]  req@ffff89d99fe66680 x1872931145120000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174547.838369:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145120000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174547.838378:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174547.838381:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174547.838384:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145120000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174552.957368:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145120128:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174552.957451:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.957508:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe66a00 x1872931145120128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.957563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145120128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.957584:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.957594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.957603:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145120128:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174552.957636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145120256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174552.957662:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.957680:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe67b80 x1872931145120256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.957713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145120256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.957736:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.957746:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.957755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145120256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174552.957767:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145120384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174552.957793:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.957805:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe65880 x1872931145120384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.957871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145120384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.957893:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.957931:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.957937:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145120384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174552.957966:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145120512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174552.958006:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.958029:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe65f80 x1872931145120512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.958084:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145120512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.958146:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.958153:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.958161:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145120512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174552.958187:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145120640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174552.958229:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.958250:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe64000 x1872931145120640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.958266:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145120640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.958274:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.958277:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.958281:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145120640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174552.958302:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145120768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174552.958331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.958355:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe66300 x1872931145120768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.958387:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145120768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.958409:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.958414:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.958422:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145120768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174552.958444:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145120896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174552.958467:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.958483:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe67100 x1872931145120896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.958492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145120896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.958499:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.958501:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.958503:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145120896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174552.958514:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145121024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174552.958527:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.958534:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe67480 x1872931145121024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.958543:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145121024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.958555:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.958557:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.958560:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145121024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174552.958564:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145121152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174552.958577:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174552.958584:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174552/real 1786174552]  req@ffff89d99fe64700 x1872931145121152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174552.958592:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145121152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174552.958598:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174552.958600:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174552.958603:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145121152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174555.005036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174556.029064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174557.053069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174558.077044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174558.077146:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145121280:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174558.077231:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.077283:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe64a80 x1872931145121280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.077335:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145121280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.077383:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.077389:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.077394:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145121280:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174558.077435:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145121408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174558.077464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.077486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe65500 x1872931145121408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.077535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145121408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.077559:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.077575:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.077584:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145121408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174558.077608:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145121536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174558.077644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.077657:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe64700 x1872931145121536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.077708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145121536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.077725:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.077732:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.077742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145121536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174558.077751:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145121664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174558.077772:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.077782:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe67480 x1872931145121664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.077795:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145121664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.077851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.077860:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.077865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145121664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174558.077874:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145121792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174558.077894:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.077903:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe67100 x1872931145121792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.077911:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145121792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.077917:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.077918:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.077920:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145121792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174558.077958:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145121920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174558.077973:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.077981:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe66300 x1872931145121920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.077990:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145121920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.077996:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.077999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.078001:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145121920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174558.078005:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145122048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174558.078017:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.078023:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe64000 x1872931145122048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.078032:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145122048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.078037:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.078039:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.078041:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145122048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174558.078045:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145122176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174558.078055:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.078076:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe65f80 x1872931145122176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.078086:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145122176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.078097:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.078099:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.078102:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145122176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174558.078123:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145122304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174558.078138:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174558.078145:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174558/real 1786174558]  req@ffff89d99fe65880 x1872931145122304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174558.078152:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145122304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174583 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174558.078158:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174558.078159:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174558.078161:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145122304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174559.101174:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174560.125074:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174561.149080:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174562.173130:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174563.197136:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174563.197484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145122432:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174563.197575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.197640:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe67b80 x1872931145122432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.197706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145122432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.197730:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.197748:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.197763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145122432:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174563.197806:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145122560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174563.197854:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.197880:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe66a00 x1872931145122560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.197984:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145122560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.198010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.198045:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.198059:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145122560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174563.198119:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145122688:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174563.198155:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.198177:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe66680 x1872931145122688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.198209:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145122688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.198231:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.198241:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.198245:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145122688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174563.198276:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145122816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174563.198323:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.198350:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe64380 x1872931145122816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.198380:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145122816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.198404:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.198414:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.198421:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145122816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174563.198445:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145122944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174563.198482:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.198501:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe66d80 x1872931145122944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.198516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145122944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.198526:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.198529:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.198533:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145122944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174563.198540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145123072:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174563.198560:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.198572:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe65180 x1872931145123072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.198586:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145123072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.198596:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.198599:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.198603:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145123072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174563.198623:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145123200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174563.198643:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.198655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe67800 x1872931145123200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.198669:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145123200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.198678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.198682:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.198685:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145123200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174563.198692:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145123328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174563.198709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.198721:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe66a00 x1872931145123328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.198734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145123328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.198754:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.198757:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.198761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145123328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174563.198767:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145123456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174563.198784:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174563.198813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174563/real 1786174563]  req@ffff89d99fe67b80 x1872931145123456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174563.198825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145123456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174563.198834:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174563.198837:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174563.198840:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145123456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174564.221034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174565.245052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174566.269037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174567.293027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174568.317071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174568.317278:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145123584:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174568.317378:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.317478:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe65880 x1872931145123584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.317536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145123584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.317578:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.317591:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.317603:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145123584:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174568.317648:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145123712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174568.317724:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.317762:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe65f80 x1872931145123712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.317791:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145123712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.317805:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.317815:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.317828:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145123712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174568.317846:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145123840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174568.317891:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.317991:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe64000 x1872931145123840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.318014:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145123840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.318027:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.318033:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.318037:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145123840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174568.318049:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145123968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174568.318079:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.318093:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe66300 x1872931145123968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.318108:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145123968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.318118:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.318121:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.318125:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145123968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174568.318132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145124096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174568.318152:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.318163:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe67100 x1872931145124096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.318177:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145124096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.318187:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.318190:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.318194:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145124096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174568.318200:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145124224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174568.318219:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.318244:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe67480 x1872931145124224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.318261:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145124224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.318277:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.318281:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.318285:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145124224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174568.318310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145124352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174568.318334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.318347:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe64700 x1872931145124352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.318361:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145124352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.318370:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.318374:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.318377:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145124352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174568.318384:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145124480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174568.318416:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.318437:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe65500 x1872931145124480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.318461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145124480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.318494:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.318501:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.318505:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145124480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174568.318514:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145124608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174568.318542:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174568.318556:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174568/real 1786174568]  req@ffff89d99fe64a80 x1872931145124608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174568.318571:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145124608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174568.318581:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174568.318585:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174568.318589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145124608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174573.437129:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145124736:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174573.437200:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437247:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe64a80 x1872931145124736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437283:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145124736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437309:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437320:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437327:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145124736:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174573.437341:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145124864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174573.437376:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe65500 x1872931145124864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437422:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145124864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437432:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437435:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437439:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145124864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174573.437462:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145124992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174573.437481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe64700 x1872931145124992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437505:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145124992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437514:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437517:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437521:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145124992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174573.437528:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145125120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174573.437545:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437556:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe67480 x1872931145125120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437570:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145125120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437579:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437582:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437586:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145125120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174573.437591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145125248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174573.437606:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437615:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe67100 x1872931145125248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437627:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145125248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437635:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437638:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437642:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145125248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174573.437648:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145125376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174573.437666:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437676:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe66300 x1872931145125376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437689:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145125376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145125376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174573.437716:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145125504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174573.437732:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437741:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe64000 x1872931145125504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145125504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145125504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174573.437774:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145125632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174573.437791:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437802:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe65f80 x1872931145125632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437815:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145125632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437823:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437827:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437831:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145125632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174573.437837:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145125760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174573.437852:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174573.437871:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174573/real 1786174573]  req@ffff89d99fe65880 x1872931145125760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174573.437884:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145125760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174573.437892:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174573.437941:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174573.437945:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145125760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174578.557300:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145125888:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174578.557398:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.557456:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe67b80 x1872931145125888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.557493:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145125888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.557551:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.557566:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.557579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145125888:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174578.557628:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145126016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174578.557698:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.557743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe66a00 x1872931145126016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.557794:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145126016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.557832:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.557852:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.557892:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145126016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174578.557983:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145126144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174578.558053:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.558083:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe67800 x1872931145126144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.558120:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145126144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.558142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.558152:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.558163:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145126144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174578.558174:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145126272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174578.558214:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.558243:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe65180 x1872931145126272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.558268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145126272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.558286:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.558294:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.558301:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145126272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174578.558332:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145126400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174578.558362:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.558377:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe66d80 x1872931145126400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.558391:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145126400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.558402:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.558406:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.558410:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145126400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174578.558417:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145126528:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174578.558436:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.558447:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe64380 x1872931145126528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.558461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145126528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.558470:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.558474:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.558479:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145126528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174578.558485:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145126656:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174578.558504:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.558514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe66680 x1872931145126656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.558528:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145126656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.558538:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.558541:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.558545:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145126656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174578.558551:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145126784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174578.558569:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.558579:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe67b80 x1872931145126784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.558593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145126784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.558602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.558606:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.558609:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145126784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174578.558618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145126912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174578.558649:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174578.558672:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174578/real 1786174578]  req@ffff89d99fe65880 x1872931145126912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174578.558697:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145126912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174578.558715:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174578.558722:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174578.558727:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145126912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174583.677147:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174583.677247:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145127040:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174583.677363:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.677436:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe65f80 x1872931145127040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.677487:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145127040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.677526:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.677535:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.677543:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145127040:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174583.677580:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145127168:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174583.677636:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.677679:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe64000 x1872931145127168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.677707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145127168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.677723:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.677728:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.677735:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145127168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174583.677767:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145127296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174583.677798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.677839:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe66300 x1872931145127296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.677857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145127296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.677885:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.677889:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.677894:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145127296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174583.677903:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145127424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174583.678034:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.678061:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe67100 x1872931145127424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.678088:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145127424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.678131:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.678149:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.678171:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145127424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174583.678236:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145127552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174583.678289:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.678317:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe67480 x1872931145127552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.678362:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145127552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.678393:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.678404:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.678416:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145127552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174583.678439:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145127680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174583.678480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.678501:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe64700 x1872931145127680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.678542:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145127680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.678569:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.678579:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.678588:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145127680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174583.678597:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145127808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174583.678627:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.678649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe65500 x1872931145127808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.678667:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145127808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.678677:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.678681:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.678684:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145127808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174583.678698:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145127936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174583.678717:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.678727:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe64a80 x1872931145127936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.678741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145127936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.678751:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.678771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.678775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145127936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174583.678783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145128064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174583.678803:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174583.678837:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174583/real 1786174583]  req@ffff89d99fe67480 x1872931145128064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174583.678855:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145128064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174583.678886:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174583.678890:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174583.678894:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145128064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174584.700984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174585.725001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174586.748978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174587.772988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174588.797006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174588.797122:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145128192:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174588.797190:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.797292:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe67100 x1872931145128192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.797373:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145128192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.797399:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.797410:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.797421:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145128192:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174588.797449:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145128320:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174588.797488:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.797512:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe66300 x1872931145128320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.797557:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145128320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.797585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.797596:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.797602:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145128320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174588.797644:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145128448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174588.797698:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.797735:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe64000 x1872931145128448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.797840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145128448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.797864:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.797871:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.797875:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145128448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174588.797887:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145128576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174588.797946:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.797959:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe65f80 x1872931145128576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.797970:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145128576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.797978:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.797980:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.797984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145128576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174588.797989:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145128704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174588.798004:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.798012:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe65880 x1872931145128704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.798022:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145128704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.798028:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.798030:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.798033:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145128704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174588.798048:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145128832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174588.798062:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.798070:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe67b80 x1872931145128832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.798079:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145128832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.798086:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.798088:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.798090:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145128832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174588.798095:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145128960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174588.798108:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.798116:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe66680 x1872931145128960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.798125:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145128960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.798132:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.798134:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.798136:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145128960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174588.798140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145129088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174588.798152:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.798159:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe64380 x1872931145129088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.798168:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145129088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.798175:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.798177:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.798179:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145129088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174588.798183:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145129216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174588.798194:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174588.798201:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174588/real 1786174588]  req@ffff89d99fe66d80 x1872931145129216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174588.798210:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145129216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174588.798217:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174588.798220:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174588.798222:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145129216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174589.821028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174590.845089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174591.869045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174592.893026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174593.917023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174593.917237:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145129344:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174593.917413:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145129472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174593.917481:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145129600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174593.917539:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145129728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174593.917599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145129856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174593.917679:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145129984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174593.917707:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145130112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174593.917792:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145130240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174593.917812:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145130368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174594.941028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174595.965049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174596.988975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786174596.989220:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786174596.989258:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786174596.989272:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174596.989316:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786174596.989324:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174596.989330:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174596.989335:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174596.989340:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174596.989345:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174596.989350:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786174596.989355:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786174598.013058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174599.036989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174599.037181:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145130496:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174599.037275:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.037334:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f2680 x1872931145130496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.037384:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145130496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.037406:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.037424:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.037435:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145130496:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174599.037497:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145130624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174599.037554:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.037584:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f2a00 x1872931145130624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.037641:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145130624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.037720:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.037730:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.037745:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145130624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174599.037776:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145130752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174599.037829:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.037856:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f3b80 x1872931145130752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.037874:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145130752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.037885:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.037889:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.037893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145130752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174599.037932:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145130880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174599.037958:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.037972:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f3480 x1872931145130880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.037985:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145130880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.038000:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.038004:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.038008:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145130880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174599.038014:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145131008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174599.038037:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.038049:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f2d80 x1872931145131008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.038058:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145131008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.038064:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.038066:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.038068:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145131008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174599.038085:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145131136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174599.038101:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.038114:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f0a80 x1872931145131136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.038127:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145131136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.038135:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.038139:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.038143:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145131136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174599.038161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145131264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174599.038184:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.038197:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f1180 x1872931145131264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.038210:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145131264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.038218:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.038221:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.038225:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145131264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174599.038232:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145131392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174599.038253:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.038265:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f0e00 x1872931145131392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.038279:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145131392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.038288:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.038291:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.038293:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145131392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174599.038298:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145131520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174599.038318:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174599.038330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174599/real 1786174599]  req@ffff89d9870f3100 x1872931145131520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174599.038341:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145131520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174624 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174599.038350:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174599.038354:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174599.038357:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145131520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174600.060962:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174601.085001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174602.109016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174603.133024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174604.156996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174604.157187:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145131648:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174604.157265:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157338:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f1500 x1872931145131648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157374:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145131648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157410:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157421:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145131648:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174604.157452:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145131776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174604.157492:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157509:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f0700 x1872931145131776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145131776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157538:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157544:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145131776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174604.157565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145131904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174604.157592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157605:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f1880 x1872931145131904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157657:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145131904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157679:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145131904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174604.157684:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145132032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174604.157706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157714:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f3100 x1872931145132032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157722:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145132032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157730:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157732:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145132032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174604.157736:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145132160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174604.157746:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157752:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f0e00 x1872931145132160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145132160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157764:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157766:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145132160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174604.157771:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145132288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174604.157781:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157786:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f1180 x1872931145132288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145132288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157798:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157800:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157802:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145132288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174604.157814:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145132416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174604.157825:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f0a80 x1872931145132416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157838:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145132416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157847:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145132416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174604.157850:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145132544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174604.157860:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157866:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f2d80 x1872931145132544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157874:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145132544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157889:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157890:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157892:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145132544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174604.157915:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145132672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174604.157928:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174604.157936:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174604/real 1786174604]  req@ffff89d9870f3480 x1872931145132672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174604.157954:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145132672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174604.157960:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174604.157962:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174604.157964:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145132672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174605.181025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174606.205008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174607.229123:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174608.252992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174609.277039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174609.277173:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145132800:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174609.277304:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.277372:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe65180 x1872931145132800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.277440:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145132800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.277511:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.277531:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.277551:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145132800:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174609.277631:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145132928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174609.277670:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.277686:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe67800 x1872931145132928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.277701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145132928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.277712:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.277716:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.277720:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145132928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174609.277727:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145133056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174609.277746:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.277756:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe66a00 x1872931145133056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.277769:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145133056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.277778:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.277781:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.277784:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145133056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174609.277789:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145133184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174609.277807:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.277816:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe66d80 x1872931145133184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.277829:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145133184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.277838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.277841:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.277845:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145133184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174609.277851:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145133312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174609.277867:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.277876:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe64380 x1872931145133312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.277888:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145133312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.277930:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.277933:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.277937:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145133312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174609.277944:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145133440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174609.277965:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.277978:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe66680 x1872931145133440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.277991:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145133440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.278000:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.278003:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.278007:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145133440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174609.278014:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145133568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174609.278032:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.278041:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe67b80 x1872931145133568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.278053:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145133568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.278061:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.278064:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.278067:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145133568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174609.278073:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145133696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174609.278090:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.278099:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe65880 x1872931145133696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.278110:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145133696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.278119:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.278123:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.278126:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145133696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174609.278132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145133824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174609.278148:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174609.278158:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174609/real 1786174609]  req@ffff89d99fe65f80 x1872931145133824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174609.278171:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145133824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174609.278179:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174609.278182:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174609.278185:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145133824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174610.300964:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174611.325008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174614.397126:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174614.397283:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145133952:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174614.397399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.397477:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2ff100 x1872931145133952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.397549:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145133952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.397573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.397582:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.397595:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145133952:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174614.397646:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145134080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174614.397724:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.397767:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2fdf80 x1872931145134080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.397873:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145134080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.397888:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.397893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.397959:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145134080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174614.397970:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145134208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174614.398005:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.398021:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2ffb80 x1872931145134208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.398037:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145134208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.398048:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.398052:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.398056:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145134208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174614.398064:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145134336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174614.398084:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.398095:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2fe300 x1872931145134336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.398110:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145134336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.398128:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.398131:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.398136:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145134336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174614.398143:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145134464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174614.398161:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.398171:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2fd500 x1872931145134464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.398185:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145134464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.398195:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.398198:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.398202:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145134464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174614.398208:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145134592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174614.398227:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.398237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2fea00 x1872931145134592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.398251:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145134592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.398261:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.398264:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.398269:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145134592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174614.398293:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145134720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174614.398313:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.398325:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2fc380 x1872931145134720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.398340:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145134720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.398356:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.398362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.398368:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145134720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174614.398380:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145134848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174614.398416:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.398440:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2ff100 x1872931145134848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.398464:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145134848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.398475:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.398479:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.398483:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145134848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174614.398491:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145134976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174614.398545:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174614.398564:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174614/real 1786174614]  req@ffff89d9ba2fd180 x1872931145134976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174614.398579:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145134976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174614.398590:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174614.398594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174614.398598:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145134976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174615.421025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174616.444977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174619.517314:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145135104:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174619.517432:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.517564:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2fd880 x1872931145135104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.517600:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145135104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.517616:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.517627:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.517638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145135104:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174619.517675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145135232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174619.517724:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.517743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2fce00 x1872931145135232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.517819:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145135232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.517878:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.517887:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.517913:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145135232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174619.517955:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145135360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174619.517998:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.518020:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2ff480 x1872931145135360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.518033:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145135360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.518041:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.518045:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.518048:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145135360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174619.518064:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145135488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174619.518082:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.518094:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2fe680 x1872931145135488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.518108:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145135488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.518133:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.518136:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.518138:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145135488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174619.518144:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145135616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174619.518161:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.518170:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2ff800 x1872931145135616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.518179:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145135616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.518187:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.518190:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.518193:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145135616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174619.518233:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145135744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174619.518289:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.518331:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2fdc00 x1872931145135744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.518351:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145135744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.518363:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.518367:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.518372:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145135744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174619.518399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145135872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174619.518437:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.518500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2fed80 x1872931145135872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.518546:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145135872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.518556:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.518560:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.518563:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145135872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174619.518569:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145136000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174619.518586:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.518595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2fc700 x1872931145136000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.518605:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145136000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.518612:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.518615:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.518618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145136000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174619.518623:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145136128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174619.518639:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174619.518656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174619/real 1786174619]  req@ffff89d9ba2fd880 x1872931145136128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174619.518670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145136128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174619.518689:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174619.518692:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174619.518695:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145136128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174624.637186:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145136256:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174624.637289:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.637357:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2fd180 x1872931145136256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.637403:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145136256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.637444:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.637457:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.637468:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145136256:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174624.637508:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145136384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174624.637553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.637586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2ff100 x1872931145136384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.637619:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145136384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.637677:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.637682:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.637687:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145136384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174624.637696:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145136512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174624.637722:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.637747:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2fc380 x1872931145136512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.637760:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145136512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.637768:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.637771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.637774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145136512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174624.637780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145136640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174624.637800:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.637809:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2fea00 x1872931145136640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.637820:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145136640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.637827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.637830:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.637833:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145136640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174624.637839:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145136768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174624.637863:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.637872:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2fd500 x1872931145136768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.637883:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145136768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.637890:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.637892:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.637927:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145136768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174624.637935:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145136896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174624.637953:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.637964:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2fe300 x1872931145136896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.637974:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145136896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.637982:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.637985:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.637988:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145136896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174624.638011:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145137024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174624.638036:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.638054:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2ffb80 x1872931145137024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.638072:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145137024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.638093:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.638097:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.638100:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145137024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174624.638106:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145137152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174624.638127:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.638138:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2fdf80 x1872931145137152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.638148:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145137152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.638156:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.638158:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.638161:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145137152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174624.638168:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145137280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174624.638191:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174624.638207:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174624/real 1786174624]  req@ffff89d9ba2fd180 x1872931145137280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174624.638226:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145137280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174624.638239:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174624.638244:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174624.638248:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145137280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174629.757221:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145137408:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174629.757406:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.757512:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2fd880 x1872931145137408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.757551:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145137408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.757574:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.757582:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.757590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145137408:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174629.757607:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145137536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174629.757653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.757671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2fc700 x1872931145137536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.757686:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145137536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.757697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.757701:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.757706:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145137536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174629.757714:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145137664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174629.757737:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.757748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2fed80 x1872931145137664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.757762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145137664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.757771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.757776:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.757781:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145137664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174629.757834:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145137792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174629.757877:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.757978:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2fdc00 x1872931145137792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.757996:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145137792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.758007:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.758011:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.758015:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145137792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174629.758023:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145137920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174629.758050:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.758063:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2ff800 x1872931145137920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.758078:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145137920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.758087:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.758090:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.758093:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145137920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174629.758100:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145138048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174629.758118:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.758129:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2fe680 x1872931145138048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.758143:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145138048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.758152:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.758155:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.758158:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145138048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174629.758164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145138176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174629.758182:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.758192:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2ff480 x1872931145138176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.758204:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145138176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.758240:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.758244:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.758248:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145138176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174629.758255:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145138304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174629.758277:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.758289:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2fce00 x1872931145138304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.758302:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145138304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.758313:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.758317:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.758321:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145138304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174629.758328:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145138432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174629.758347:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174629.758358:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174629/real 1786174629]  req@ffff89d9ba2fd180 x1872931145138432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174629.758419:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145138432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174629.758430:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174629.758433:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174629.758438:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145138432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174634.877391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145138560:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174634.877508:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.877608:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2fdf80 x1872931145138560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.877701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145138560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.877748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.877770:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.877788:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145138560:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174634.877822:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145138688:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174634.877970:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.878014:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2ffb80 x1872931145138688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.878060:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145138688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.878080:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.878086:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.878094:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145138688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174634.878140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145138816:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174634.878183:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.878206:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2fe300 x1872931145138816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.878228:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145138816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.878243:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.878249:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.878255:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145138816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174634.878266:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145138944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174634.878300:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.878346:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2fd500 x1872931145138944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.878383:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145138944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.878399:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.878406:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.878412:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145138944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174634.878426:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145139072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174634.878469:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.878496:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2fea00 x1872931145139072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.878531:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145139072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.878549:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.878556:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.878562:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145139072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174634.878575:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145139200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174634.878618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.878644:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2fc380 x1872931145139200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.878678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145139200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.878696:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.878703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.878709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145139200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174634.878722:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145139328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174634.878763:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.878787:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2ff100 x1872931145139328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.878810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145139328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.878826:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.878833:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.878841:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145139328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174634.878854:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145139456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174634.878933:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.878963:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2fd180 x1872931145139456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.878989:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145139456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.879007:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.879013:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.879021:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145139456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174634.879035:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145139584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174634.879076:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174634.879100:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174634/real 1786174634]  req@ffff89d9ba2fce00 x1872931145139584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174634.879126:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145139584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174634.879141:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174634.879147:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174634.879154:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145139584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174639.997355:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145139712:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174639.997481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.997547:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2ff480 x1872931145139712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.997572:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145139712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.997590:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.997599:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.997610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145139712:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174639.997649:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145139840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174639.997681:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.997707:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2fe680 x1872931145139840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.997751:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145139840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.997778:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.997787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.997796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145139840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174639.997811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145139968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174639.997848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.997864:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2ff800 x1872931145139968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.997876:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145139968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.997891:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.997894:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.997898:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145139968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174639.997905:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145140096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174639.997982:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.997995:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2fdc00 x1872931145140096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.998005:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145140096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.998013:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.998016:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.998019:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145140096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174639.998025:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145140224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174639.998041:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.998049:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2fed80 x1872931145140224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.998059:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145140224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.998066:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.998070:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.998075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145140224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174639.998102:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145140352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174639.998131:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.998146:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2fc700 x1872931145140352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.998158:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145140352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.998182:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.998185:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.998189:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145140352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174639.998195:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145140480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174639.998215:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.998224:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2fd880 x1872931145140480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.998252:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145140480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.998258:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.998260:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.998263:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145140480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174639.998267:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145140608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174639.998304:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.998315:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2ff480 x1872931145140608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.998345:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145140608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.998354:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.998357:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.998360:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145140608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174639.998365:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145140736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174639.998382:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174639.998391:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174639/real 1786174639]  req@ffff89d9ba2fce00 x1872931145140736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174639.998403:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145140736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174639.998411:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174639.998413:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174639.998416:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145140736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174645.117484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145140864:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174645.117629:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.117748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f3b80 x1872931145140864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.117820:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145140864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.117866:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.117881:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.117898:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145140864:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174645.118007:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145140992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174645.118096:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.118142:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f2a00 x1872931145140992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.118195:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145140992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.118261:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.118292:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.118303:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145140992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174645.118323:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145141120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174645.118389:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.118420:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f2680 x1872931145141120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.118456:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145141120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.118473:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.118480:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.118486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145141120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174645.118499:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145141248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174645.118535:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.118557:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f3480 x1872931145141248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.118580:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145141248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.118596:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.118601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.118607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145141248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174645.118619:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145141376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174645.118652:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.118691:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f2d80 x1872931145141376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.118718:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145141376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.118735:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.118742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.118749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145141376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174645.118787:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145141504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174645.118828:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.118853:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f0a80 x1872931145141504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.118878:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145141504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.118895:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.118902:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.118909:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145141504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174645.118920:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145141632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174645.119002:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.119028:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f1180 x1872931145141632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.119054:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145141632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.119071:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.119077:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.119084:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145141632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174645.119096:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145141760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174645.119135:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.119159:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f0e00 x1872931145141760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.119183:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145141760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.119215:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.119248:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.119256:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145141760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174645.119285:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145141888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174645.119321:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174645.119341:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174645/real 1786174645]  req@ffff89d9870f3100 x1872931145141888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174645.119362:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145141888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174645.119377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174645.119383:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174645.119389:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145141888:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786174650.237077:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237088:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174650.237094:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237106:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237130:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237139:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174650.237219:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145142016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174650.237255:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237259:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174650.237261:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237265:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237269:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237273:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174650.237284:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174650.237297:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145142144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174650.237307:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237310:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174650.237314:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237321:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237329:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237342:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174650.237347:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174650.237361:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145142272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174650.237369:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237372:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174650.237374:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237377:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237380:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237383:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174650.237389:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174650.237399:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145142400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174650.237408:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237411:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174650.237413:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237419:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237425:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237432:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174650.237439:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174650.237455:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145142528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174650.237478:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237483:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174650.237486:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237494:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237501:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237511:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174650.237521:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174650.237545:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145142656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174650.237559:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237570:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174650.237575:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237588:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237597:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237615:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174650.237622:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174650.237634:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145142784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174650.237652:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237657:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174650.237661:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237672:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237680:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237685:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174650.237702:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174650.237713:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145142912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174650.237723:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174650.237727:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174650.237729:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174650.237737:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8384
00000100:00080000:2.0:1786174650.237752:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174650.237757:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174650.237761:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174650.237773:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145143040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357071:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357088:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174655.357096:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.357114:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.357157:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.357174:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174655.357252:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145143168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357291:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357295:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174655.357298:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.357307:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.357324:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.357329:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174655.357343:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174655.357373:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145143296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357405:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357408:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174655.357410:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.357415:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.357421:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.357429:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174655.357437:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174655.357459:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145143424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357479:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357508:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174655.357512:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.357519:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.357526:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.357533:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174655.357541:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174655.357564:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145143552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357587:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357592:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174655.357594:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.357607:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.357616:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.357624:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174655.357636:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174655.357656:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145143680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357680:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357688:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174655.357692:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.357699:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.357704:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.357715:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174655.357750:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174655.357768:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145143808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357791:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357795:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174655.357797:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.357804:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.357809:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.357814:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174655.357820:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174655.357841:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145143936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357854:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357859:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174655.357863:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.357875:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.357887:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.357926:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174655.357934:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174655.357950:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145144064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174655.357991:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174655.357997:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174655.357999:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174655.358004:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8389
00000100:00080000:2.0:1786174655.358010:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174655.358018:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174655.358025:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174655.358057:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145144192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174659.452979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174659.965164:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174660.477058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174660.477089:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477105:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174660.477114:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.477130:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.477148:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.477159:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174660.477225:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145144320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174660.477265:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477271:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174660.477273:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.477278:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.477283:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.477289:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174660.477304:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174660.477322:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145144448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174660.477347:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477354:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174660.477357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.477366:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.477372:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.477379:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174660.477386:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174660.477406:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145144576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174660.477420:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477426:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174660.477429:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.477434:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.477440:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.477447:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174660.477457:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174660.477480:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145144704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174660.477511:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477522:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174660.477525:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.477533:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.477541:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.477549:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174660.477560:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174660.477592:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145144832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174660.477634:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477642:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174660.477646:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.477656:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.477663:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.477681:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174660.477695:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174660.477722:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145144960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174660.477741:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477746:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174660.477749:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.477758:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.477765:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.477782:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174660.477791:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174660.477816:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145145088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174660.477833:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477839:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174660.477842:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.477853:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.477863:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.477875:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174660.477885:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174660.477964:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145145216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174660.477985:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174660.477991:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174660.477995:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174660.478002:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8394
00000100:00080000:2.0:1786174660.478009:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174660.478013:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174660.478020:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174660.478036:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145145344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174660.989231:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174661.500966:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174662.013144:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174662.525135:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174663.037127:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174663.549030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:3.0:1786174663.549279:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:3.0:1786174663.549314:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1786174663.549328:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174663.549381:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:3.0:1786174663.549391:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174663.549403:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174663.549423:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174663.549436:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174663.549451:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174663.549465:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174663.549492:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00010000:00010000:3.0:1786174664.061181:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174664.573024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174665.085190:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174665.597071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174665.597200:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145145472:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174665.597274:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.597314:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f1880 x1872931145145472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.597339:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145145472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.597352:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.597363:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.597370:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145145472:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174665.597401:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145145600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174665.597438:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.597458:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f0700 x1872931145145600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.597485:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145145600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.597506:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.597514:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.597521:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145145600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174665.597532:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145145728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174665.597577:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.597595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f1500 x1872931145145728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.597623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145145728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.597635:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.597640:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.597644:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145145728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174665.597652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145145856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174665.597675:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.597688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f3100 x1872931145145856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.597699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145145856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.597707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.597710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.597713:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145145856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174665.597718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145145984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174665.597739:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.597751:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f0e00 x1872931145145984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.597774:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145145984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.597783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.597786:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.597789:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145145984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174665.597807:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145146112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174665.597829:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.597841:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f1180 x1872931145146112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.597855:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145146112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.597863:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.597867:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.597870:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145146112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174665.597875:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145146240:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174665.597917:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.597932:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f0a80 x1872931145146240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.597945:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145146240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.597959:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.597962:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.597966:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145146240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174665.597972:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145146368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174665.597993:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.598005:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f2d80 x1872931145146368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.598015:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145146368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.598040:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.598044:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.598047:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145146368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174665.598053:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145146496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174665.598074:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174665.598087:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174665/real 1786174665]  req@ffff89d9870f3480 x1872931145146496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174665.598100:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145146496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174665.598109:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174665.598111:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174665.598116:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145146496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174666.621065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174667.133198:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174667.645049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174668.157087:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174668.669068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174669.181099:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174670.205093:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174670.717217:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145146624:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174670.717285:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.717340:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2fd180 x1872931145146624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.717368:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145146624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.717385:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.717396:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.717407:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145146624:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174670.717446:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145146752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174670.717486:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.717510:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2ff100 x1872931145146752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.717545:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145146752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.717566:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.717577:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.717586:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145146752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174670.717602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145146880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174670.717637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.717654:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2fc380 x1872931145146880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.717678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145146880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.717692:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.717700:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.717709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145146880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174670.717727:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145147008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174670.717750:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.717761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2fea00 x1872931145147008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.717784:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145147008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.717800:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.717808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.717813:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145147008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174670.717820:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145147136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174670.717845:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.717855:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2fd500 x1872931145147136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.717877:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145147136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.717920:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.717922:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.717926:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145147136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174670.717932:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145147264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174670.717959:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.717999:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2fe300 x1872931145147264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.718028:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145147264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.718046:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.718055:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.718065:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145147264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174670.718093:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145147392:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174670.718114:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.718124:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2ffb80 x1872931145147392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.718134:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145147392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.718145:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.718148:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.718151:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145147392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174670.718155:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145147520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174670.718167:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.718175:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2fdf80 x1872931145147520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.718184:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145147520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.718190:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.718192:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.718194:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145147520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174670.718199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145147648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174670.718210:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174670.718217:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174670/real 1786174670]  req@ffff89d9ba2fc380 x1872931145147648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174670.718226:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145147648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174670.718232:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174670.718234:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174670.718237:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145147648:192.168.202.130@tcp:8:kworker.0
00010000:00010000:3.0:1786174671.229166:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174672.253186:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174673.277117:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174674.301209:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174675.325162:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174675.837051:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174675.837060:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174675.837065:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174675.837077:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00080000:3.0:1786174675.837087:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174675.837108:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174675.837158:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145147776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174675.837210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174675.837217:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174675.837220:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174675.837226:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00080000:3.0:1786174675.837234:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174675.837243:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174675.837260:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145147776:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786174675.837260:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174675.837294:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145147904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174675.837312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174675.837317:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174675.837319:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174675.837324:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00080000:3.0:1786174675.837331:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174675.837336:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174675.837342:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174675.837348:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174675.837366:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145148032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174675.837379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174675.837384:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174675.837386:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174675.837391:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00080000:3.0:1786174675.837396:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174675.837404:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe64000 x1872931145147776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174675.837405:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174675.837416:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174675.837439:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145148160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174675.837451:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145147776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174675.837482:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174675.837488:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174675.837489:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174675.837495:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174675.837502:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174675.837508:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00080000:3.0:1786174675.837522:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174675.837528:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145147776:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174675.837530:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174675.837543:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174675.837558:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145148288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174675.837572:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145147904:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174675.837572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174675.837585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174675.837589:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174675.837598:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00080000:3.0:1786174675.837611:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786174675.837619:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174675.837626:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174675.837638:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174675.837641:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe66300 x1872931145147904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174675.837661:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145147904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174675.837671:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145148416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174675.837675:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174675.837690:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174675.837702:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145147904:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174675.837707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174675.837714:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:2.0:1786174675.837715:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145148032:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174675.837720:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174675.837729:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00080000:3.0:1786174675.837736:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174675.837742:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786174675.837749:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786174675.837751:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174675.837767:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe67100 x1872931145148032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174675.837775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145148544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174675.837822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174675.837826:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145148032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174675.837827:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174675.837849:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174675.837861:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00080000:2.0:1786174675.837870:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174675.837871:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174675.837881:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786174675.837884:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786174675.837889:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174675.837891:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145148032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174675.837907:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145148160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174675.837982:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145148672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174675.837990:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174675.838013:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe67480 x1872931145148160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174675.838015:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174675.838039:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174675.838044:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174675.838052:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8410
00000100:00100000:2.0:1786174675.838057:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145148160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174675.838061:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174675.838074:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786174675.838078:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786174675.838083:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786174675.838086:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174675.838093:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145148160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174675.838106:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145148800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174675.838117:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145148288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174675.838157:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174675.838191:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe64a80 x1872931145148288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174675.838205:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145148288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174675.838214:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174675.838218:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174675.838221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145148288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174675.838227:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145148416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174675.838245:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174675.838255:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe65500 x1872931145148416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174675.838267:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145148416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174675.838275:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174675.838278:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174675.838281:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145148416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174675.838287:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145148544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174675.838301:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174675.838310:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe64700 x1872931145148544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174675.838321:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145148544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174675.838329:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174675.838333:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174675.838337:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145148544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174675.838343:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145148672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174675.838359:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174675.838368:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe64000 x1872931145148672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174675.838379:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145148672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174675.838388:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174675.838391:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174675.838394:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145148672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174675.838417:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145148800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174675.838433:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174675.838443:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174675/real 1786174675]  req@ffff89d99fe65f80 x1872931145148800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174675.838454:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145148800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174675.838463:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174675.838466:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174675.838470:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145148800:192.168.202.130@tcp:8:kworker.0
00010000:00010000:3.0:1786174676.349209:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174677.373122:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174678.397038:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174679.421176:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174680.445182:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174680.957048:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174680.957061:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174680.957067:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174680.957083:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00080000:3.0:1786174680.957103:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174680.957114:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174680.957165:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145148928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174680.957203:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174680.957208:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174680.957212:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174680.957217:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00080000:3.0:1786174680.957222:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174680.957228:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174680.957240:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174680.957258:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145149056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174680.957268:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145148928:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174680.957284:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174680.957290:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174680.957300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174680.957306:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00080000:3.0:1786174680.957310:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174680.957315:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174680.957322:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174680.957339:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145149184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174680.957352:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174680.957358:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174680.957361:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174680.957365:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00080000:3.0:1786174680.957370:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174680.957374:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786174680.957384:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786174680.957386:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174680.957420:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145149312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174680.957433:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174680.957437:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174680.957440:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174680.957447:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00080000:3.0:1786174680.957453:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174680.957460:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe65880 x1872931145148928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174680.957465:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174680.957484:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174680.957510:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145149440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174680.957520:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145148928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174680.957534:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174680.957553:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174680.957558:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174680.957560:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174680.957569:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00080000:2.0:1786174680.957576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174680.957579:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174680.957589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145148928:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174680.957592:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174680.957608:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174680.957623:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145149568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174680.957638:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174680.957639:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145149056:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174680.957652:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174680.957658:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174680.957665:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00080000:3.0:1786174680.957672:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174680.957678:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174680.957685:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174680.957693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174680.957708:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145149696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174680.957721:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe67b80 x1872931145149056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174680.957732:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174680.957748:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174680.957755:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174680.957765:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00100000:2.0:1786174680.957766:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145149056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174680.957770:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174680.957785:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786174680.957794:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786174680.957796:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786174680.957807:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174680.957820:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145149824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174680.957821:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145149056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174680.957844:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145149184:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174680.957851:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174680.957858:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174680.957862:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174680.957869:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8415
00000100:00080000:3.0:1786174680.957931:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174680.957938:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174680.957946:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786174680.957965:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174680.957968:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145149952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174680.958007:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe66680 x1872931145149184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174680.958038:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145149184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174680.958069:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174680.958073:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174680.958078:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145149184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174680.958087:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145149312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174680.958120:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174680.958136:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe64380 x1872931145149312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174680.958168:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145149312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174680.958184:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174680.958188:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174680.958192:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145149312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174680.958200:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145149440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174680.958224:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174680.958237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe66d80 x1872931145149440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174680.958251:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145149440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174680.958260:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174680.958264:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174680.958268:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145149440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174680.958303:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145149568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174680.958323:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174680.958335:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe66a00 x1872931145149568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174680.958349:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145149568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174680.958359:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174680.958362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174680.958366:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145149568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174680.958373:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145149696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174680.958399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174680.958410:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe67800 x1872931145149696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174680.958424:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145149696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174680.958433:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174680.958436:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174680.958440:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145149696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174680.958446:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145149824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174680.958464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174680.958476:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe65180 x1872931145149824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174680.958499:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145149824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174680.958509:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174680.958512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174680.958515:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145149824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174680.958522:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145149952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174680.958539:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174680.958550:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174680/real 1786174680]  req@ffff89d99fe65880 x1872931145149952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174680.958563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145149952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174680.958573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174680.958576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174680.958580:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145149952:192.168.202.130@tcp:8:kworker.0
00010000:00010000:3.0:1786174681.469220:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174682.493185:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174683.517033:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174684.029014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174684.541112:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174685.053031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174685.565144:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174686.077011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786174686.077256:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145150080:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786174686.077384:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.077492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f2680 x1872931145150080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.077578:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145150080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.077618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.077634:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.077652:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145150080:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174686.077707:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145150208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174686.077781:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.077820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f2a00 x1872931145150208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.077967:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145150208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.078010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.078025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.078043:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145150208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174686.078069:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145150336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174686.078121:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.078147:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f3b80 x1872931145150336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.078175:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145150336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.078194:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.078202:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.078210:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145150336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174686.078225:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145150464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174686.078269:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.078293:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f3480 x1872931145150464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.078320:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145150464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.078338:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.078345:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.078351:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145150464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174686.078364:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145150592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174686.078407:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.078432:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f2d80 x1872931145150592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.078459:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145150592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.078477:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.078483:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.078490:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145150592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174686.078503:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145150720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174686.078543:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.078568:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f0a80 x1872931145150720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.078595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145150720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.078613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.078619:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.078626:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145150720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174686.078665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145150848:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174686.078704:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.078728:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f1180 x1872931145150848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.078753:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145150848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.078769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.078775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.078783:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145150848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174686.078795:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145150976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174686.078870:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.078933:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f0e00 x1872931145150976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.078964:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145150976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.078994:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.079001:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.079008:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145150976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174686.079021:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145151104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174686.079064:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174686.079089:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174686/real 1786174686]  req@ffff89d9870f3100 x1872931145151104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174686.079112:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145151104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174711 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174686.079131:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174686.079137:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174686.079143:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145151104:192.168.202.130@tcp:8:kworker.0
00010000:00010000:3.0:1786174686.589098:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174687.101067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174687.613147:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174688.125043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174688.637143:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174689.149006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174689.661127:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174690.172999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174690.685142:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174691.197027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174691.709223:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174692.221036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174692.733203:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174693.245027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174693.757121:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174694.268958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174694.781131:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174695.293042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174695.805083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174696.317057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.317082:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174696.317089:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.317104:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.317120:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.317133:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174696.317183:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145152384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174696.317239:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.317246:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174696.317249:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.317257:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.317264:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.317272:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174696.317285:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174696.317309:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145152512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174696.317342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.317348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174696.317351:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.317359:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.317365:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.317372:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174696.317380:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174696.317402:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145152640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174696.317457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.317464:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174696.317467:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.317477:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.317484:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.317491:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174696.317502:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174696.317530:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145152768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174696.317557:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.317566:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174696.317576:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.317594:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.317607:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.317623:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174696.317637:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174696.317692:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145152896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174696.317752:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.317760:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174696.317781:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.317802:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.317813:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.317826:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174696.317835:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174696.317865:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145153024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174696.317963:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.317978:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174696.317994:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.318020:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.318032:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.318049:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174696.318061:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174696.318102:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145153152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174696.318120:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.318133:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174696.318137:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.318148:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.318159:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.318174:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174696.318186:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174696.318221:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145153280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174696.318308:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174696.318321:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174696.318327:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174696.318348:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8430
00000100:00080000:3.0:1786174696.318357:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174696.318364:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174696.318373:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174696.318407:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145153408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174696.829127:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174697.853086:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174698.877262:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174699.901144:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174700.925091:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174701.437093:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437110:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174701.437115:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437129:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437140:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437147:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174701.437204:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145153536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174701.437228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437231:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174701.437232:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437235:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437238:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437240:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174701.437248:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174701.437257:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145153664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174701.437267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174701.437272:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437276:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437279:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437281:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174701.437284:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174701.437290:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145153792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174701.437298:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437305:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174701.437308:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437323:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437329:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437332:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174701.437336:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174701.437347:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145153920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174701.437353:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437355:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174701.437356:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437358:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437360:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437361:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174701.437364:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174701.437371:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145154048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174701.437378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437380:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174701.437381:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437383:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437386:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437388:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174701.437391:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174701.437397:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145154176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174701.437405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437408:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174701.437410:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437414:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437418:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437421:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174701.437424:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174701.437431:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145154304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174701.437438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174701.437441:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437444:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437447:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437449:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174701.437452:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174701.437470:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145154432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174701.437495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174701.437499:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174701.437500:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174701.437506:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8435
00000100:00080000:2.0:1786174701.437509:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174701.437513:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174701.437518:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174701.437529:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145154560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174701.949069:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174702.973178:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174703.997208:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174705.021218:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174706.045126:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174706.557099:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.557114:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174706.557122:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.557159:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.557189:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.557207:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174706.557288:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145154688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174706.557339:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.557345:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174706.557348:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.557353:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.557359:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.557365:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174706.557380:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174706.557398:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145154816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174706.557413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.557419:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174706.557421:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.557426:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.557431:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.557444:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174706.557466:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174706.557492:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145154944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174706.557508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.557514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174706.557517:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.557521:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.557525:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.557530:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174706.557539:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174706.557560:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145155072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174706.557578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.557585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174706.557587:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.557592:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.557597:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.557605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174706.557615:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174706.557665:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145155200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174706.557701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.557708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174706.557712:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.557730:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.557748:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.557768:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174706.557793:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174706.557838:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145155328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174706.557880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.557889:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174706.557960:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.557977:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.557989:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.558006:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174706.558022:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174706.558056:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145155456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174706.558117:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.558121:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174706.558124:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.558147:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.558160:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.558185:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174706.558216:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174706.558250:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145155584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174706.558298:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174706.558305:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174706.558309:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174706.558318:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8440
00000100:00080000:2.0:1786174706.558327:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174706.558333:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174706.558345:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174706.558374:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145155712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174707.069117:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174708.093099:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174709.117016:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174710.141178:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174711.165137:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786174711.677668:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8445
00000100:00080000:0.0:1786174711.677685:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174711.677699:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174711.677713:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174711.677744:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145156864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174712.189183:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174713.213222:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174714.237227:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174715.261092:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174716.285202:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174716.797112:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797119:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174716.797131:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797143:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797154:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797163:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174716.797240:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145156992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174716.797271:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797275:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174716.797277:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797281:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797286:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797291:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174716.797320:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174716.797334:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145157120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174716.797343:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797346:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174716.797347:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797350:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797352:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797355:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174716.797359:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174716.797368:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145157248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174716.797376:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797379:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174716.797380:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797382:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797386:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797388:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174716.797392:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174716.797400:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145157376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174716.797411:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797415:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174716.797417:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797423:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797428:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797430:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174716.797434:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174716.797442:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145157504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174716.797449:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797452:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174716.797453:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797456:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797458:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797466:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174716.797471:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174716.797482:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145157632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174716.797509:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797512:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174716.797514:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797517:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797522:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797542:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174716.797546:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174716.797555:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145157760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174716.797569:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797576:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174716.797580:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797589:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797596:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797601:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174716.797603:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174716.797611:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145157888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174716.797619:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174716.797624:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174716.797629:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174716.797634:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8451
00000100:00080000:2.0:1786174716.797637:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174716.797640:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174716.797644:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174716.797655:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145158016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174717.309122:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174718.333077:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174719.357057:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174720.381084:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174721.405075:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786174721.917122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917132:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174721.917138:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917150:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917163:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917173:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174721.917221:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145158144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174721.917261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917267:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174721.917269:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917274:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917279:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917283:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174721.917296:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174721.917311:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145158272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174721.917327:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917339:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174721.917346:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917356:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917360:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917364:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174721.917370:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174721.917386:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145158400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174721.917398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917402:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174721.917406:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917411:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917430:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917434:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174721.917441:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174721.917463:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145158528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174721.917506:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917511:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174721.917514:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917522:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917528:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917538:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174721.917553:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174721.917578:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145158656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174721.917607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174721.917625:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917634:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917639:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917650:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174721.917659:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174721.917678:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145158784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174721.917709:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917714:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174721.917716:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917723:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917726:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917732:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174721.917756:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174721.917777:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145158912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174721.917791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917797:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174721.917800:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917812:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917818:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917825:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174721.917832:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174721.917846:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145159040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174721.917863:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174721.917874:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174721.917879:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174721.917893:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8456
00000100:00080000:0.0:1786174721.917963:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174721.917977:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174721.917997:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174721.918039:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145159168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174722.429115:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174723.453138:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174724.477076:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174725.501069:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174726.525063:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174727.036999:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.037011:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174727.037016:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.037025:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00080000:3.0:1786174727.037033:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.037041:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174727.037068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786174727.037076:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145159296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174727.037100:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.037103:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174727.037105:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.037108:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00080000:3.0:1786174727.037112:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.037115:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174727.037124:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174727.037135:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145159296:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786174727.037139:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145159424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174727.037152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.037154:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174727.037155:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.037159:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00080000:3.0:1786174727.037162:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.037165:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174727.037168:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174727.037180:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145159552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174727.037188:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.037190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174727.037192:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.037195:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00080000:3.0:1786174727.037197:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.037200:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174727.037204:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174727.037214:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145159680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174727.037221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.037231:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174727.037233:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.037238:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00080000:3.0:1786174727.037241:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.037245:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174727.037250:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174727.037252:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145159424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174727.037263:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145159808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174727.037274:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.037277:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174727.037279:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.037284:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00100000:0.0:1786174727.037285:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145159552:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174727.037289:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.037293:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174727.037297:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174727.037308:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145159936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786174727.037310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145159680:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786174727.037323:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.037326:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174727.037328:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.037333:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00080000:3.0:1786174727.037337:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.037340:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174727.037344:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145159808:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786174727.037345:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174727.037364:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145159936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174727.038692:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145160064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174727.038719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.038727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174727.038729:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.038735:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00080000:3.0:1786174727.038742:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.038750:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174727.038758:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174727.038776:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145160064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174727.038828:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145160192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174727.038841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174727.038845:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786174727.038849:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145160192:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786174727.038850:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174727.038860:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8461
00000100:00080000:3.0:1786174727.038866:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174727.038871:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174727.038877:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174727.038892:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145160320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786174727.038972:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145160320:192.168.202.130@tcp:8:kworker.0
00010000:00010000:3.0:1786174727.549047:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174728.061040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174728.573063:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174729.084989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174729.597060:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174730.109015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786174730.109221:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786174730.109266:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786174730.109281:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174730.109336:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786174730.109351:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174730.109363:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174730.109377:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174730.109414:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174730.109424:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174730.109434:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174730.109451:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00010000:00010000:3.0:1786174730.621101:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174731.133013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174731.645070:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174732.156987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174732.156989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174732.157000:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174732.157006:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157018:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157031:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157041:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174732.157084:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145160448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174732.157112:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174732.157115:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174732.157116:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157119:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157122:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157125:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174732.157136:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174732.157148:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145160576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174732.157162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174732.157165:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174732.157167:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157170:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157172:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157175:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174732.157179:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174732.157193:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145160704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174732.157204:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174732.157208:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174732.157210:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157214:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157219:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157223:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174732.157229:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174732.157256:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145160832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174732.157270:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174732.157275:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174732.157278:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157282:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157287:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157291:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174732.157296:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174732.157309:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145160960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174732.157319:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174732.157326:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174732.157330:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157341:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157346:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157351:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174732.157357:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174732.157372:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145161088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174732.157404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174732.157409:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174732.157411:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157417:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157424:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157432:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174732.157443:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174732.157458:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145161216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174732.157470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174732.157478:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174732.157483:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157489:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157493:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157498:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174732.157511:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174732.157529:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145161344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174732.157555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174732.157560:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174732.157565:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174732.157575:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8466
00000100:00080000:3.0:1786174732.157582:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174732.157589:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174732.157597:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174732.157617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145161472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174732.669125:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174733.181008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174733.693096:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174734.717029:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174735.741163:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174736.765130:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786174737.277021:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277028:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174737.277033:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277042:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277051:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277057:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174737.277088:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145161600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174737.277115:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174737.277120:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277123:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277125:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277129:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174737.277144:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174737.277160:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145161728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174737.277169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277172:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174737.277173:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277176:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277178:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277181:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174737.277184:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174737.277193:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145161856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174737.277200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277202:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174737.277203:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277205:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277209:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277215:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174737.277221:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174737.277230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145161984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174737.277237:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277239:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174737.277240:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277243:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277245:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277248:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174737.277251:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174737.277259:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145162112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174737.277269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277276:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174737.277279:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277285:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277287:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277293:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174737.277299:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174737.277310:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145162240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174737.277353:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277355:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174737.277357:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277361:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277364:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277371:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174737.277377:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174737.277388:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145162368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174737.277398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277402:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174737.277403:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277407:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277411:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277417:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174737.277424:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174737.277434:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145162496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174737.277448:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174737.277453:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174737.277456:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174737.277462:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8471
00000100:00080000:0.0:1786174737.277466:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174737.277472:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174737.277477:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174737.277486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145162624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174737.789030:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174738.813195:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174739.837145:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174740.861094:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174741.885256:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786174742.397132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.397144:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174742.397152:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.397166:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.397181:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.397194:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174742.397260:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145162752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174742.397317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.397322:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174742.397325:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.397330:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.397350:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.397358:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174742.397373:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174742.397403:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145162880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174742.397428:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.397439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174742.397443:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.397451:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.397468:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.397474:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174742.397482:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174742.397505:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145163008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174742.397520:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.397524:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174742.397526:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.397531:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.397536:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.397539:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174742.397546:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174742.397564:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145163136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174742.397635:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.397641:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174742.397644:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.397654:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.397659:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.397670:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174742.397685:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174742.397706:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145163264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174742.397724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.397734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174742.397737:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.397762:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.397767:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.397772:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174742.397777:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174742.397794:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145163392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174742.397815:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.397819:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174742.397821:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.397825:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.397829:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.397852:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174742.397858:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174742.397879:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145163520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174742.397894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.397900:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174742.397906:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.397922:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.397936:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.397987:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174742.398019:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174742.398051:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145163648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174742.398092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174742.398097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174742.398100:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174742.398107:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8476
00000100:00080000:0.0:1786174742.398114:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174742.398125:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174742.398133:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174742.398162:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145163776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174742.909130:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174743.933109:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174744.957066:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174745.981042:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174747.005083:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174747.517080:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.517090:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174747.517095:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.517107:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.517118:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.517128:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174747.517172:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145163904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174747.517206:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.517210:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174747.517213:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.517217:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.517221:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.517226:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174747.517258:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174747.517275:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145164032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174747.517293:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.517303:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174747.517306:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.517312:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.517316:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.517319:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174747.517326:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174747.517342:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145164160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174747.517353:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.517357:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174747.517359:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.517362:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.517367:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.517371:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174747.517377:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174747.517396:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145164288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174747.517421:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.517427:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174747.517431:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.517442:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.517458:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.517489:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174747.517508:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174747.517538:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145164416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174747.517556:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.517561:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174747.517567:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.517580:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.517585:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.517592:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174747.517598:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174747.517612:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145164544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174747.517656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.517661:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174747.517665:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.517673:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.517681:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.517689:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174747.517705:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174747.517735:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145164672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174747.517813:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.517828:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174747.517835:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.517847:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.517859:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.517874:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174747.517892:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174747.517969:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145164800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174747.518000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174747.518010:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174747.518015:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174747.518022:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8481
00000100:00080000:2.0:1786174747.518028:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174747.518034:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174747.518041:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174747.518062:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145164928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174748.029191:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174748.541123:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174749.053180:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174749.565008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174750.077197:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174750.589056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174751.101162:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174751.613046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174752.125183:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174752.637029:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637041:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174752.637046:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637063:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637077:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637090:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174752.637137:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145165056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174752.637169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637173:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174752.637175:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637195:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637200:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637205:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174752.637217:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174752.637233:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145165184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174752.637250:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637256:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174752.637258:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637263:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637267:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637270:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174752.637274:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174752.637288:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145165312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174752.637298:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637301:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174752.637304:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637307:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637311:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637315:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174752.637319:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174752.637333:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145165440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174752.637345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637349:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174752.637351:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637355:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637358:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637361:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174752.637365:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174752.637376:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145165568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174752.637384:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637388:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174752.637394:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637407:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637418:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637426:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174752.637435:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174752.637472:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145165696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174752.637483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174752.637489:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637497:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637505:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637510:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174752.637516:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174752.637531:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145165824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174752.637554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637558:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174752.637560:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637567:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637574:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637583:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174752.637591:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174752.637613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145165952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174752.637646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174752.637654:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174752.637658:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174752.637668:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8486
00000100:00080000:2.0:1786174752.637674:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174752.637684:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174752.637690:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174752.637703:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145166080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174753.149084:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174754.173227:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174755.197250:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174756.221118:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174756.733110:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174757.245253:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174757.756987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.756997:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174757.757001:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757011:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757020:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786174757.757023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174757.757029:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174757.757067:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145166208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174757.757094:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.757098:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174757.757099:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757103:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757105:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174757.757108:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174757.757116:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174757.757126:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145166336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174757.757162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.757166:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174757.757168:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757172:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757175:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174757.757179:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174757.757184:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174757.757194:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145166464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174757.757205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.757216:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174757.757219:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757223:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757226:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174757.757228:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174757.757233:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174757.757243:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145166592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174757.757250:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.757253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174757.757255:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757258:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757261:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174757.757264:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174757.757269:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174757.757279:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145166720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174757.757294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.757297:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174757.757300:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757305:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757307:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174757.757310:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174757.757314:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174757.757324:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145166848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174757.757337:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.757346:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174757.757350:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757357:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757360:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174757.757368:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174757.757392:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174757.757405:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145166976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174757.757425:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.757431:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174757.757434:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757443:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757446:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174757.757450:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174757.757455:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174757.757470:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145167104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174757.757481:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174757.757486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174757.757491:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174757.757500:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8491
00000100:00080000:2.0:1786174757.757508:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174757.757515:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174757.757522:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174757.757539:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145167232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174758.269326:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174758.780987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174759.293201:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174759.805083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174760.317176:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174760.829032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174761.341205:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174761.852997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174762.365189:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174762.877065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174762.877067:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.877111:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174762.877118:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.877137:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.877154:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.877171:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174762.877252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145167360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174762.877319:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.877325:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174762.877328:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.877333:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.877343:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.877351:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174762.877367:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174762.877404:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145167488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174762.877438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.877444:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174762.877446:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.877457:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.877466:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.877484:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174762.877493:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174762.877522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145167616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174762.877545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.877554:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174762.877561:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.877572:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.877588:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.877618:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174762.877632:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174762.877657:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145167744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174762.877674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.877679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174762.877682:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.877693:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.877703:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.877711:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174762.877726:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174762.877756:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145167872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174762.877783:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.877810:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174762.877822:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.877836:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.877854:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.877873:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174762.877885:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174762.877951:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145168000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174762.877978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.877983:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174762.877986:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.877997:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.878006:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.878010:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174762.878017:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174762.878043:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145168128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174762.878064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.878075:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174762.878110:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.878124:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.878132:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.878145:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174762.878170:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174762.878210:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145168256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174762.878267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174762.878289:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174762.878295:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174762.878305:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8497
00000100:00080000:2.0:1786174762.878327:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174762.878337:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174762.878350:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174762.878375:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145168384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174763.389168:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174763.901020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174764.413146:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174764.925105:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174765.437310:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174765.949020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174766.461246:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174766.973078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174767.485169:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174767.997050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997081:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174767.997088:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174767.997091:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174767.997101:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997115:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997145:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174767.997215:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145168512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174767.997254:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997259:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174767.997261:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174767.997266:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997270:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997274:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174767.997284:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174767.997300:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145168640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174767.997312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997319:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174767.997331:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174767.997340:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997349:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997353:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174767.997359:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174767.997375:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145168768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174767.997388:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997392:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174767.997395:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174767.997399:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997403:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997407:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174767.997412:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174767.997429:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145168896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174767.997441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997446:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174767.997449:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174767.997453:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997456:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997460:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174767.997467:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174767.997483:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145169024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174767.997544:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174767.997551:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174767.997556:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997560:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997564:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174767.997569:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174767.997588:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145169152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174767.997612:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997625:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174767.997627:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174767.997637:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997647:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997657:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174767.997669:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174767.997690:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145169280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174767.997716:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997719:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174767.997723:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174767.997729:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997734:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997739:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174767.997745:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174767.997765:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145169408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174767.997797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174767.997807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174767.997813:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174767.997825:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8502
00000100:00080000:2.0:1786174767.997832:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174767.997842:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174767.997851:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174767.997873:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145169536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174768.509125:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174769.021016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174769.533136:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174770.045095:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174770.557203:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174771.069135:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174771.581116:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174772.093028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174772.605057:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174773.116995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174773.117005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117041:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174773.117045:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117056:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117065:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117075:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174773.117115:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145169664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174773.117143:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117146:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174773.117147:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117150:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117153:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117157:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174773.117165:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174773.117178:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145169792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174773.117190:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117192:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174773.117193:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117196:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117199:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117201:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174773.117204:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174773.117213:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145169920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174773.117220:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117222:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174773.117223:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117226:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117229:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117248:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174773.117253:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174773.117269:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145170048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174773.117277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117280:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174773.117281:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117284:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117287:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117291:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174773.117295:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174773.117307:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145170176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174773.117344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117346:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174773.117351:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117360:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117367:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117372:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174773.117379:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174773.117391:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145170304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174773.117426:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117430:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174773.117433:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117437:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117441:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117450:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174773.117455:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174773.117467:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145170432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174773.117496:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174773.117510:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117521:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117526:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117535:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174773.117541:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174773.117554:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145170560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174773.117564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174773.117568:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174773.117570:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174773.117574:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8507
00000100:00080000:2.0:1786174773.117581:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174773.117589:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174773.117593:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174773.117622:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145170688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:3.0:1786174773.629126:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174774.141026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174774.653230:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174775.165000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174775.677137:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174776.189013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786174776.701049:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1786174777.725055:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174778.236998:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237005:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174778.237015:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237026:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237036:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237044:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174778.237082:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145170816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174778.237104:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237107:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174778.237109:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237112:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237115:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237118:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174778.237127:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174778.237138:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145170944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174778.237150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237154:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174778.237156:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237159:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237161:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237163:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174778.237166:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174778.237176:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145171072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174778.237181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237183:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174778.237185:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237188:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237191:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237193:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174778.237196:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174778.237206:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145171200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174778.237214:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237217:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174778.237218:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237220:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237222:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237225:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174778.237229:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174778.237238:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145171328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174778.237251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174778.237254:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237257:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237262:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237268:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174778.237271:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174778.237282:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145171456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174778.237296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237303:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174778.237306:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237311:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237314:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237320:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174778.237323:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174778.237331:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145171584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174778.237342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237345:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174778.237347:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237351:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237353:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237356:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174778.237359:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174778.237364:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145171712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174778.237372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174778.237380:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174778.237382:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174778.237386:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8512
00000100:00080000:2.0:1786174778.237388:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174778.237391:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174778.237395:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174778.237405:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145171840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174778.237514:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145171200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174778.237528:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174778.237535:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174778/real 1786174778]  req@ffff89d99e87e680 x1872931145171200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174778.237542:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145171200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174778.237547:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174778.237549:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174778.237550:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145171200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174778.237554:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145171328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174778.237564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174778.237569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174778/real 1786174778]  req@ffff89d99e87c380 x1872931145171328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174778.237576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145171328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174778.237581:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174778.237583:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174778.237585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145171328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174778.237588:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145171456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174778.237598:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174778.237603:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174778/real 1786174778]  req@ffff89d99e87c700 x1872931145171456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174778.237616:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145171456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174778.237621:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174778.237622:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174778.237624:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145171456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174778.237627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145171584:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174778.237637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174778.237642:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174778/real 1786174778]  req@ffff89d99e87ca80 x1872931145171584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174778.237649:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145171584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174778.237653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174778.237656:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174778.237658:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145171584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174778.237674:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145171712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174778.237684:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174778.237690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174778/real 1786174778]  req@ffff89d99e87df80 x1872931145171712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174778.237697:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145171712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174778.237707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174778.237709:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174778.237711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145171712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174778.237715:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145171840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174778.237724:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174778.237729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174778/real 1786174778]  req@ffff89d99e87f800 x1872931145171840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174778.237737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145171840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174778.237742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174778.237744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174778.237746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145171840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174778.749045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174778.749095:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174779.261012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174779.773080:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174779.773204:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174780.285069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174780.797044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174780.797146:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174781.309022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174781.821030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174781.821173:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174782.333094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174782.845107:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174782.845225:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174783.357093:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174783.357100:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174783.357119:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174783.357127:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174783.357143:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00080000:3.0:1786174783.357159:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174783.357173:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174783.357232:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145171968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174783.357276:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174783.357281:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174783.357283:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174783.357289:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00080000:3.0:1786174783.357294:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174783.357301:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174783.357314:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174783.357334:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145172096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174783.357352:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145171968:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174783.357357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174783.357373:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174783.357379:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174783.357407:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00080000:3.0:1786174783.357416:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174783.357426:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174783.357437:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174783.357466:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145172224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174783.357489:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174783.357495:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174783.357497:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174783.357502:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00080000:3.0:1786174783.357508:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174783.357514:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174783.357523:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174783.357538:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174783.357550:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145172352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174783.357573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174783.357581:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174783.357584:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174783.357594:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00080000:3.0:1786174783.357602:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174783.357614:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174783.357625:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe66a00 x1872931145171968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786174783.357627:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174783.357658:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145171968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174783.357689:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145172480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174783.357697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174783.357714:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174783.357717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174783.357724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145171968:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174783.357738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174783.357746:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174783.357759:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00080000:3.0:1786174783.357769:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174783.357783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145172096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174783.357786:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174783.357806:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174783.357836:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145172608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786174783.357864:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174783.357961:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe67800 x1872931145172096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174783.357983:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174783.357989:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145172096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174783.358006:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174783.358019:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174783.358021:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174783.358045:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174783.358053:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00100000:1.0:1786174783.358060:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145172096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174783.358069:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174783.358077:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145172224:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174783.358081:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174783.358096:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174783.358118:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145172736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174783.358132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174783.358142:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786174783.358148:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174783.358148:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174783.358171:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00080000:3.0:1786174783.358180:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174783.358191:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174783.358201:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe65180 x1872931145172224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786174783.358207:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174783.358244:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145172864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174783.358247:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145172224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174783.358344:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174783.358345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174783.358362:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174783.358368:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174783.358371:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174783.358379:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8517
00000100:00080000:3.0:1786174783.358386:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174783.358392:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145172224:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174783.358402:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174783.358421:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174783.358428:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145172352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174783.358457:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145172992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786174783.358480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174783.358512:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe64380 x1872931145172352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174783.358534:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145172352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174783.358547:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174783.358552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174783.358556:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145172352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174783.358566:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145172480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174783.358588:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174783.358599:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe66d80 x1872931145172480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174783.358614:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145172480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174783.358633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174783.358637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174783.358641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145172480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174783.358683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145172608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174783.358704:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174783.358716:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe66680 x1872931145172608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174783.358731:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145172608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174783.358742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174783.358745:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174783.358749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145172608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174783.358756:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145172736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174783.358776:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174783.358787:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe67b80 x1872931145172736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174783.358800:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145172736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174783.358810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174783.358814:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174783.358819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145172736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174783.358826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145172864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174783.358845:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174783.358855:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe65f80 x1872931145172864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174783.358869:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145172864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174783.358879:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174783.358941:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174783.358947:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145172864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174783.358957:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145172992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174783.358986:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174783.359001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174783/real 1786174783]  req@ffff89d99fe66a00 x1872931145172992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174783.359017:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145172992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174783.359028:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174783.359032:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174783.359036:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145172992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174783.869030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174783.869125:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174784.381050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174784.893056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174784.893156:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174785.405203:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174785.917020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174785.917109:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174786.429025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174786.941041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174786.941139:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174787.453045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174787.965061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174787.965203:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174788.477070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174788.477079:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174788.477093:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174788.477101:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174788.477118:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.477138:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174788.477152:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174788.477220:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145173120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174788.477261:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174788.477267:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174788.477269:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174788.477274:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.477279:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174788.477284:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174788.477300:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174788.477317:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145173248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174788.477331:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174788.477336:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174788.477339:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174788.477344:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.477348:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174788.477355:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174788.477363:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174788.477381:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145173376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174788.477384:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145173120:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174788.477429:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174788.477433:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174788.477435:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174788.477444:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.477452:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174788.477457:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174788.477464:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174788.477481:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145173504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174788.477495:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174788.477500:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174788.477502:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174788.477508:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.477517:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174788.477521:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174788.477528:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174788.477541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174788.477543:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145173632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174788.477563:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174788.477570:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174788.477573:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174788.477580:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.477587:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174788.477593:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174788.477598:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174788.477614:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145173760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174788.477627:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174788.477638:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe65880 x1872931145173120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174788.477639:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174788.477650:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174788.477678:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.477691:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174788.477701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145173120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174788.477704:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174788.477728:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174788.477758:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145173888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174788.477759:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.477792:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174788.477795:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174788.477805:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174788.477809:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174788.477819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145173120:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174788.477824:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.477880:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174788.477883:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145173248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174788.477940:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174788.477952:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174788.477981:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145174016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174788.477999:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174788.478004:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174788.478007:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174788.478018:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8522
00000100:00080000:3.0:1786174788.478025:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174788.478032:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786174788.478045:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786174788.478050:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174788.478080:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145174144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174788.478081:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe66300 x1872931145173248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174788.478169:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145173248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174788.478189:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.478196:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174788.478203:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145173248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174788.478255:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145173376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174788.478296:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174788.478313:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe64000 x1872931145173376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174788.478330:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145173376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174788.478341:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.478345:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174788.478349:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145173376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174788.478358:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145173504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174788.478380:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174788.478391:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe64700 x1872931145173504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174788.478406:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145173504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174788.478415:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.478419:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174788.478423:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145173504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174788.478430:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145173632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174788.478449:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174788.478460:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe65500 x1872931145173632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174788.478490:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145173632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174788.478505:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.478511:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174788.478518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145173632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174788.478531:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145173760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174788.478570:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174788.478593:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe64a80 x1872931145173760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174788.478610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145173760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174788.478621:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.478625:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174788.478629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145173760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174788.478637:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145173888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174788.478663:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174788.478675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe67480 x1872931145173888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174788.478689:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145173888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174788.478706:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.478710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174788.478715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145173888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174788.478721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145174016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174788.478740:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174788.478750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe67100 x1872931145174016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174788.478764:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145174016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174788.478775:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.478778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174788.478781:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145174016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174788.478788:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145174144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174788.478806:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174788.478816:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174788/real 1786174788]  req@ffff89d99fe66a00 x1872931145174144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174788.478829:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145174144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174788.478865:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174788.478870:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174788.478875:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145174144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174788.989031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174788.989155:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174789.501037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174790.013000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174790.013113:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174790.525048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174791.037033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174791.037104:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174791.549027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174792.061068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174792.061155:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174792.572973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174793.084990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174793.085036:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174793.596983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174793.596984:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.596992:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174793.596996:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174793.597005:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00080000:0.0:1786174793.597031:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597038:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174793.597074:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145174272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174793.597100:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.597103:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174793.597105:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174793.597108:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00080000:0.0:1786174793.597110:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597113:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174793.597122:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174793.597131:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145174400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174793.597149:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.597152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174793.597154:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174793.597160:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00100000:1.0:1786174793.597161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145174272:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174793.597163:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597170:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174793.597176:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174793.597207:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145174528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174793.597213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.597216:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174793.597217:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174793.597219:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00080000:0.0:1786174793.597221:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597224:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174793.597227:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174793.597235:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145174656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174793.597241:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.597243:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174793.597244:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174793.597246:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00080000:0.0:1786174793.597249:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597251:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174793.597254:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174793.597261:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145174784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174793.597266:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.597269:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174793.597270:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174793.597273:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00080000:0.0:1786174793.597275:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597277:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174793.597281:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174793.597288:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145174912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174793.597295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145174400:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174793.597297:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.597303:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174793.597304:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174793.597307:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00080000:0.0:1786174793.597309:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597312:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174793.597315:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174793.597327:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145174528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174793.597328:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145175040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174793.597340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.597342:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174793.597344:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174793.597351:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145174656:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786174793.597354:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00080000:0.0:1786174793.597360:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597363:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174793.597367:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174793.597375:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145174784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174793.597379:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145175168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174793.597387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174793.597389:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174793.597391:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174793.597394:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8527
00000100:00080000:0.0:1786174793.597399:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174793.597402:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174793.597407:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174793.597407:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145174912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174793.597422:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145175296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174793.597434:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145175040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174793.597450:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145175168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174793.597466:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145175296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174794.108975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174794.109034:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174794.621094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174795.133010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174795.133099:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174795.645125:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174796.157065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174796.157154:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174796.669243:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786174796.669417:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786174796.669494:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786174796.669519:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174796.669604:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786174796.669630:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174796.669651:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174796.669674:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174796.669697:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786174796.669697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f3100 x1872931145175296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786174796.669736:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174796.669790:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786174796.669815:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145175296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786174796.669819:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786174796.669855:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.669868:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.669879:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145175296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174796.669943:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f0a80 x1872931145174912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174796.669987:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145174912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174796.670005:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.670013:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.670022:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145174912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174796.670040:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f1180 x1872931145175040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174796.670066:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145175040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174796.670081:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.670087:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.670094:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145175040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174796.670107:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f0e00 x1872931145175168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174796.670130:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145175168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174796.670148:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.670155:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.670163:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145175168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174796.670176:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f2a00 x1872931145174400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174796.670200:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145174400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174796.670217:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.670225:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.670232:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145174400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174796.670245:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f2680 x1872931145174528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174796.670268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145174528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174796.670285:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.670292:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.670298:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145174528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174796.670312:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f3480 x1872931145174656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174796.670351:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145174656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174796.670369:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.670377:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.670384:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145174656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174796.670397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f2d80 x1872931145174784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174796.670422:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145174784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174796.670437:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.670443:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.670449:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145174784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174796.670462:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174793/real 1786174796]  req@ffff89d9870f3b80 x1872931145174272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174796.670485:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145174272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174796.670501:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174796.670508:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174796.670515:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145174272:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786174797.181061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174797.181218:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174797.693045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174798.204978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174798.205039:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174798.716978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.716986:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174798.716990:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174798.716999:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8532
00000100:00080000:3.0:1786174798.717008:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174798.717015:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174798.717032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786174798.717048:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145175424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174798.717080:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.717083:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174798.717085:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174798.717087:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8532
00000100:00080000:3.0:1786174798.717090:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174798.717095:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174798.717103:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174798.717112:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145175424:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786174798.717117:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145175552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174798.717127:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.717129:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174798.717131:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174798.717134:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8532
00000100:00080000:3.0:1786174798.717136:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174798.717139:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174798.717142:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174798.717152:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145175680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174798.717158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.717160:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174798.717162:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174798.717166:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8532
00000100:00080000:3.0:1786174798.717170:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174798.717176:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786174798.717182:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786174798.717186:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174798.717212:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145175808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174798.717224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.717228:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174798.717230:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174798.717235:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8532
00000100:00100000:2.0:1786174798.717237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe65f80 x1872931145175424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174798.717240:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174798.717249:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174798.717260:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174798.717271:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145175424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174798.717277:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145175936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174798.717299:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174798.717299:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.717307:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174798.717311:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174798.717312:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174798.717322:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145175424:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174798.717322:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8532
00000100:00080000:3.0:1786174798.717336:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174798.717343:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174798.717349:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174798.717355:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145175552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174798.717365:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145176064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174798.717378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.717382:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174798.717384:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174798.717391:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8532
00000800:00000100:2.0:1786174798.717392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174798.717399:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174798.717406:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174798.717413:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174798.717418:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe67b80 x1872931145175552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174798.717430:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145176192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174798.717437:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145175552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174798.717445:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.717455:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174798.717458:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174798.717461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174798.717465:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8532
00000100:00080000:2.0:1786174798.717471:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174798.717471:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174798.717481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145175552:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174798.717482:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174798.717492:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174798.717497:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145175680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174798.717510:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145176320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174798.717522:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174798.717525:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174798.717527:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786174798.717532:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174798.717535:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8532
00000100:00080000:3.0:1786174798.717541:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174798.717545:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174798.717551:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174798.717555:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe66680 x1872931145175680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174798.717565:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145176448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174798.717576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145175680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174798.717587:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174798.717591:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174798.717595:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145175680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174798.717602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145175808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174798.717623:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174798.717633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe66d80 x1872931145175808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174798.717643:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145175808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174798.717651:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174798.717653:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174798.717656:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145175808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174798.717661:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145175936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174798.717679:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174798.717690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe64380 x1872931145175936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174798.717708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145175936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174798.717716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174798.717719:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174798.717722:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145175936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174798.717760:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145176064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174798.717781:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174798.717793:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe65180 x1872931145176064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174798.717806:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145176064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174798.717814:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174798.717818:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174798.717821:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145176064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174798.717827:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145176192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174798.717854:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174798.717866:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe67800 x1872931145176192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174798.717878:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145176192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174798.717891:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174798.717894:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174798.717922:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145176192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174798.717929:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145176320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174798.717953:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174798.717966:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe65f80 x1872931145176320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174798.717979:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145176320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174798.717988:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174798.717992:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174798.717996:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145176320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174798.718002:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145176448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174798.718021:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174798.718032:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174798/real 1786174798]  req@ffff89d99fe66a00 x1872931145176448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174798.718043:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145176448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174798.718051:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174798.718054:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174798.718058:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145176448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174799.229029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174799.229077:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174799.741197:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174800.252998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174800.253130:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174800.764986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174801.277077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174801.277160:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174801.789059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174802.301010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174802.301058:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174802.812977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174803.325003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174803.325083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174803.837050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174803.837061:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786174803.837065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174803.837066:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837081:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:3.0:1786174803.837092:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837101:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174803.837157:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145176576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174803.837199:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174803.837203:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174803.837205:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837209:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:3.0:1786174803.837213:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837216:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174803.837226:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174803.837239:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145176704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174803.837263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174803.837269:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145176576:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174803.837269:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174803.837273:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837282:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:3.0:1786174803.837287:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837290:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174803.837294:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174803.837306:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145176832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174803.837316:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174803.837319:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174803.837321:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837324:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:3.0:1786174803.837327:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837331:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174803.837335:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174803.837347:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145176960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174803.837356:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174803.837360:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174803.837362:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837366:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:3.0:1786174803.837370:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837377:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786174803.837383:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786174803.837385:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174803.837399:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145177088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174803.837424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174803.837427:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174803.837428:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837431:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:3.0:1786174803.837433:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837436:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174803.837440:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174803.837451:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145177216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174803.837459:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174803.837461:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe67100 x1872931145176576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174803.837463:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174803.837466:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837490:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:3.0:1786174803.837495:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837503:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174803.837513:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174803.837533:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145177344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174803.837534:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145176576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174803.837557:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174803.837565:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174803.837569:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837578:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:2.0:1786174803.837582:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174803.837582:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837591:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174803.837596:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786174803.837600:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174803.837608:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145177472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174803.837615:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145176576:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174803.837626:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174803.837631:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174803.837649:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174803.837653:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8538
00000100:00080000:3.0:1786174803.837656:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174803.837659:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174803.837662:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174803.837674:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145177600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174803.837676:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145176704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174803.837737:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174803.837756:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe67480 x1872931145176704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174803.837773:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145176704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174803.837785:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174803.837790:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174803.837795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145176704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174803.837803:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145176832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174803.837829:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174803.837846:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe64a80 x1872931145176832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174803.837861:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145176832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174803.837871:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174803.837875:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174803.837880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145176832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174803.837888:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145176960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174803.837957:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174803.837974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe65500 x1872931145176960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174803.837992:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145176960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174803.838003:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174803.838008:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174803.838013:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145176960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174803.838022:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145177088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174803.838050:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174803.838099:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe64700 x1872931145177088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174803.838134:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145177088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174803.838145:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174803.838149:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174803.838154:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145177088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174803.838161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145177216:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174803.838202:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174803.838220:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe64000 x1872931145177216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174803.838239:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145177216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174803.838251:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174803.838255:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174803.838260:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145177216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174803.838268:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145177344:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174803.838294:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174803.838309:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe66300 x1872931145177344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174803.838323:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145177344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174803.838334:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174803.838338:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174803.838342:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145177344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174803.838351:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145177472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174803.838379:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174803.838395:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe65880 x1872931145177472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174803.838427:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145177472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174803.838437:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174803.838441:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174803.838445:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145177472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174803.838488:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145177600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174803.838514:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174803.838528:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174803/real 1786174803]  req@ffff89d99fe67100 x1872931145177600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174803.838543:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145177600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174803.838553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174803.838558:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174803.838563:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145177600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174804.348990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174804.349062:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174804.860964:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174805.373060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174805.373307:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174805.885009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174806.396984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174806.397032:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174806.908984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174807.420994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174807.421050:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174807.933045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174808.445104:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174808.445177:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174808.957008:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174808.957018:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786174808.957021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174808.957023:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174808.957035:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00080000:3.0:1786174808.957045:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174808.957054:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174808.957095:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145177728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174808.957122:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174808.957126:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174808.957128:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174808.957131:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00080000:3.0:1786174808.957134:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174808.957137:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174808.957158:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174808.957169:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145177856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174808.957180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145177728:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174808.957183:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174808.957194:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174808.957196:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174808.957200:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00080000:3.0:1786174808.957203:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174808.957205:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174808.957210:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174808.957234:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145177984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174808.957250:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174808.957254:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174808.957256:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174808.957259:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00080000:3.0:1786174808.957266:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174808.957270:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174808.957275:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786174808.957283:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174808.957289:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145178112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174808.957301:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174808.957304:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174808.957306:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174808.957309:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00080000:3.0:1786174808.957312:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174808.957315:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174808.957321:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174808.957330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe66a00 x1872931145177728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174808.957335:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145178240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174808.957370:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174808.957373:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174808.957375:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174808.957381:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145177728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174808.957384:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00080000:3.0:1786174808.957391:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174808.957399:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174808.957411:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786174808.957420:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786174808.957426:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145178368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174808.957431:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174808.957442:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145177728:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174808.957447:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174808.957452:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174808.957454:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174808.957459:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00080000:3.0:1786174808.957462:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174808.957465:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174808.957469:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174808.957474:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145177856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174808.957482:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145178496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174808.957492:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174808.957496:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174808.957498:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174808.957501:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00080000:3.0:1786174808.957505:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786174808.957507:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174808.957512:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174808.957519:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174808.957531:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe65f80 x1872931145177856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174808.957533:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145178624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174808.957582:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145177856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174808.957598:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174808.957601:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174808.957610:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174808.957611:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174808.957617:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174808.957620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145177856:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174808.957632:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8543
00000100:00100000:2.0:1786174808.957655:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145177984:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174808.957673:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786174808.957685:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174808.957691:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174808.957699:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174808.957713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe67800 x1872931145177984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174808.957718:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145178752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174808.957757:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145177984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174808.957767:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174808.957773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174808.957776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145177984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174808.957783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145178112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174808.957802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174808.957811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe65180 x1872931145178112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174808.957822:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145178112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174808.957828:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174808.957831:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174808.957833:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145178112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174808.957840:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145178240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174808.957873:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174808.957890:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe64380 x1872931145178240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174808.957939:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145178240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174808.957948:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174808.957951:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174808.957954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145178240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174808.957963:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145178368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174808.957993:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174808.958011:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe66d80 x1872931145178368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174808.958030:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145178368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174808.958040:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174808.958043:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174808.958046:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145178368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174808.958084:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145178496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174808.958124:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174808.958141:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe66680 x1872931145178496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174808.958153:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145178496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174808.958161:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174808.958163:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174808.958166:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145178496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174808.958172:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145178624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174808.958199:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174808.958208:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe67b80 x1872931145178624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174808.958218:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145178624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174808.958225:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174808.958227:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174808.958230:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145178624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174808.958234:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145178752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174808.958247:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174808.958255:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174808/real 1786174808]  req@ffff89d99fe66a00 x1872931145178752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174808.958265:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145178752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174808.958272:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174808.958274:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174808.958277:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145178752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174809.469098:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174809.469190:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174809.981031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174810.493075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174810.493204:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174811.004969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174811.516995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174811.517146:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174812.029041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174812.541017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174812.541081:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174813.052994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174813.565012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174813.565110:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174814.077008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786174814.077080:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174814.077086:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786174814.077101:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174814.077109:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00080000:1.0:1786174814.077117:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077123:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174814.077160:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145178880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174814.077189:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174814.077193:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174814.077195:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174814.077199:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00080000:1.0:1786174814.077204:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077208:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174814.077218:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174814.077224:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145178880:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786174814.077238:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145179008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174814.077250:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174814.077253:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174814.077255:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174814.077258:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00080000:1.0:1786174814.077262:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077265:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174814.077270:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174814.077281:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145179136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174814.077289:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786174814.077293:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174814.077296:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174814.077297:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174814.077300:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00080000:1.0:1786174814.077303:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077306:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174814.077309:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174814.077316:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145179264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174814.077322:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174814.077325:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174814.077326:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174814.077336:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2ff100 x1872931145178880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174814.077337:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00080000:1.0:1786174814.077343:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077350:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174814.077356:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174814.077363:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145178880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174814.077367:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145179392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174814.077380:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174814.077382:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174814.077386:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174814.077387:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174814.077390:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174814.077394:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145178880:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786174814.077396:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00080000:1.0:1786174814.077403:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077406:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174814.077409:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174814.077417:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145179520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174814.077424:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174814.077426:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145179008:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174814.077428:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174814.077432:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174814.077436:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00080000:1.0:1786174814.077439:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077441:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174814.077445:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174814.077455:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174814.077456:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145179648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174814.077464:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174814.077470:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1786174814.077470:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2fd180 x1872931145179008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174814.077474:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174814.077486:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00100000:2.0:1786174814.077491:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145179008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174814.077493:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077503:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786174814.077503:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174814.077512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786174814.077514:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174814.077516:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145179008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174814.077524:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145179136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174814.077532:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145179776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174814.077541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786174814.077542:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174814.077548:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174814.077550:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174814.077555:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8548
00000100:00100000:2.0:1786174814.077556:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2fce00 x1872931145179136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174814.077559:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174814.077566:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174814.077571:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174814.077574:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145179136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174814.077581:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786174814.077582:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145179904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174814.077603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174814.077606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145179136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174814.077613:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145179264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174814.077638:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174814.077656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2ff480 x1872931145179264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174814.077663:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145179264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174814.077669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174814.077671:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174814.077673:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145179264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174814.077677:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145179392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174814.077687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174814.077693:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2fd880 x1872931145179392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174814.077700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145179392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174814.077705:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174814.077707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174814.077709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145179392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174814.077721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145179520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174814.077732:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174814.077738:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2fc700 x1872931145179520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174814.077746:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145179520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174814.077751:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174814.077752:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174814.077754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145179520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174814.077757:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145179648:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174814.077767:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174814.077773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2fed80 x1872931145179648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174814.077780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145179648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174814.077786:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174814.077788:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174814.077790:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145179648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174814.077794:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145179776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174814.077802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174814.077808:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2fdc00 x1872931145179776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174814.077814:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145179776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174814.077820:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174814.077822:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174814.077824:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145179776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174814.077827:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145179904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174814.077836:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174814.077841:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174814/real 1786174814]  req@ffff89d9ba2ff800 x1872931145179904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174814.077848:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145179904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174839 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174814.077853:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174814.077855:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174814.077857:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145179904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174814.588996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174814.589086:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174815.100990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174815.613072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174815.613201:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174816.125021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174816.637090:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174816.637125:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174817.149030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174817.661039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174817.661116:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174818.173023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174818.685026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174818.685109:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786174819.197057:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174819.197083:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786174819.197085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786174819.197092:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174819.197112:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00080000:1.0:1786174819.197126:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174819.197136:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174819.197184:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145180032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174819.197223:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174819.197231:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174819.197236:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174819.197245:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00080000:1.0:1786174819.197254:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174819.197264:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174819.197281:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174819.197287:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145180032:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786174819.197348:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145180160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174819.197366:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174819.197373:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174819.197375:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174819.197381:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00080000:1.0:1786174819.197387:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174819.197393:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174819.197410:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174819.197427:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145180288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174819.197439:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174819.197444:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174819.197447:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174819.197453:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00080000:1.0:1786174819.197457:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174819.197462:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174819.197468:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786174819.197493:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174819.197495:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145180416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174819.197515:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174819.197521:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174819.197525:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174819.197530:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00080000:1.0:1786174819.197579:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174819.197598:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174819.197605:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174819.197621:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145180544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174819.197635:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174819.197640:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174819.197644:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174819.197650:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00080000:1.0:1786174819.197658:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174819.197660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2fe680 x1872931145180032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174819.197670:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174819.197691:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174819.197717:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145180672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174819.197724:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145180032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174819.197783:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174819.197790:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174819.197794:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174819.197794:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174819.197826:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174819.197828:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00080000:1.0:1786174819.197855:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174819.197862:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145180032:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786174819.197870:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174819.197883:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174819.197933:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145180800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174819.197955:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174819.197955:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145180160:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174819.197989:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174819.197995:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174819.198003:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00080000:1.0:1786174819.198011:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174819.198018:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174819.198025:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786174819.198035:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174819.198052:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145180928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174819.198063:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2ff800 x1872931145180160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174819.198089:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174819.198116:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174819.198126:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174819.198136:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8553
00000100:00100000:2.0:1786174819.198142:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145180160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174819.198146:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174819.198168:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786174819.198171:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786174819.198181:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786174819.198183:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174819.198200:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145180160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174819.198212:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145181056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174819.198223:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145180288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174819.198275:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174819.198287:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2fdc00 x1872931145180288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174819.198320:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145180288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174819.198331:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174819.198335:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174819.198339:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145180288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174819.198347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145180416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174819.198398:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174819.198410:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2fed80 x1872931145180416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174819.198424:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145180416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174819.198434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174819.198438:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174819.198463:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145180416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174819.198468:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145180544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174819.198485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174819.198496:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2fc700 x1872931145180544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174819.198507:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145180544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174819.198514:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174819.198517:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174819.198520:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145180544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174819.198525:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145180672:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174819.198562:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174819.198573:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2fd880 x1872931145180672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174819.198585:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145180672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174819.198593:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174819.198597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174819.198600:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145180672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174819.198625:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145180800:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174819.198643:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174819.198652:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2ff480 x1872931145180800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174819.198663:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145180800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174819.198672:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174819.198675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174819.198677:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145180800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174819.198683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145180928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174819.198698:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174819.198706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2fce00 x1872931145180928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174819.198716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145180928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174819.198725:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174819.198729:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174819.198731:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145180928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174819.198738:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145181056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174819.198753:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174819.198761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174819/real 1786174819]  req@ffff89d9ba2fd180 x1872931145181056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174819.198772:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145181056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174819.198780:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174819.198783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174819.198786:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145181056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174819.709021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174819.709137:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174820.221038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174820.733072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174820.733135:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174821.244975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174821.757022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174821.757122:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174822.268988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174822.780985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174822.781029:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174823.293040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174823.804983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174823.805099:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786174824.317062:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174824.317074:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174824.317080:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174824.317082:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174824.317095:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:2.0:1786174824.317110:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174824.317120:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174824.317170:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145181184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174824.317208:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174824.317213:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174824.317215:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174824.317220:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:2.0:1786174824.317225:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174824.317229:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174824.317256:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174824.317282:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145181312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174824.317294:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145181184:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174824.317318:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174824.317328:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174824.317334:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174824.317345:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:2.0:1786174824.317355:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174824.317363:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174824.317375:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786174824.317391:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174824.317405:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145181440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174824.317422:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174824.317426:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174824.317429:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174824.317435:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:2.0:1786174824.317442:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174824.317448:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174824.317455:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87dc00 x1872931145181184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786174824.317460:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174824.317518:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145181568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174824.317521:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145181184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174824.317548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174824.317563:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174824.317573:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174824.317577:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174824.317586:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:1.0:1786174824.317593:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786174824.317605:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174824.317606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145181184:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174824.317626:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174824.317638:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174824.317652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145181312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174824.317672:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145181696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174824.317691:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174824.317697:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174824.317700:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786174824.317712:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174824.317713:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:2.0:1786174824.317728:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174824.317736:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174824.317744:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174824.317760:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87c000 x1872931145181312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174824.317766:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145181824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174824.317826:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174824.317841:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174824.317848:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174824.317860:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:2.0:1786174824.317868:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174824.317873:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174824.317881:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145181312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786174824.317883:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174824.317948:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145181952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174824.317962:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174824.317978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174824.317987:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786174824.317988:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174824.317997:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174824.318003:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145181312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786174824.318011:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:2.0:1786174824.318019:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174824.318025:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145181440:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786174824.318033:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174824.318045:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174824.318063:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145182080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174824.318076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174824.318081:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174824.318083:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174824.318088:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8558
00000100:00080000:2.0:1786174824.318094:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786174824.318100:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174824.318106:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174824.318115:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174824.318131:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87ed80 x1872931145181440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174824.318137:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145182208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174824.318217:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145181440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174824.318238:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174824.318247:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174824.318254:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145181440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174824.318274:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145181568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174824.318308:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174824.318324:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87f800 x1872931145181568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174824.318339:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145181568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174824.318358:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174824.318362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174824.318366:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145181568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174824.318390:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145181696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174824.318409:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174824.318421:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87df80 x1872931145181696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174824.318435:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145181696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174824.318445:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174824.318448:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174824.318452:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145181696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174824.318459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145181824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174824.318477:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174824.318521:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87ca80 x1872931145181824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174824.318550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145181824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174824.318560:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174824.318564:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174824.318569:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145181824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174824.318577:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145181952:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174824.318604:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174824.318618:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87c700 x1872931145181952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174824.318633:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145181952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174824.318642:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174824.318645:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174824.318649:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145181952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174824.318656:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145182080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174824.318684:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174824.318706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87c380 x1872931145182080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174824.318730:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145182080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174824.318748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174824.318754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174824.318762:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145182080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174824.318774:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145182208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174824.318804:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174824.318821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174824/real 1786174824]  req@ffff89d99e87e680 x1872931145182208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174824.318859:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145182208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174824.318870:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174824.318874:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174824.318889:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145182208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174824.829029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174824.829148:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174825.341099:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174825.853066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174825.853164:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174826.365051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174826.877079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174826.877256:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174827.389035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174827.901093:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174827.901196:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174828.412992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174828.925087:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174828.925290:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174829.437087:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174829.437096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174829.437107:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174829.437113:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174829.437126:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437141:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437151:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174829.437218:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145182336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174829.437262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174829.437268:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174829.437269:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174829.437273:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437276:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437279:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174829.437303:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174829.437314:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145182464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174829.437324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174829.437328:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174829.437331:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174829.437335:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437337:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437340:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174829.437346:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174829.437357:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145182592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174829.437367:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174829.437373:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174829.437382:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174829.437383:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145182336:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174829.437405:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437411:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437415:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174829.437422:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174829.437462:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145182720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174829.437472:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174829.437475:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174829.437478:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174829.437482:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437487:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437491:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174829.437497:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174829.437507:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145182848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174829.437516:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174829.437519:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174829.437521:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174829.437524:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437527:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437536:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786174829.437545:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786174829.437547:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174829.437566:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145182976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174829.437574:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174829.437578:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174829.437581:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174829.437588:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437594:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437597:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174829.437613:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174829.437624:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145183104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174829.437633:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174829.437637:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174829.437639:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174829.437649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87f100 x1872931145182336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174829.437653:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437664:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437680:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174829.437691:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174829.437703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145182336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174829.437707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145183232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174829.437778:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174829.437780:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174829.437791:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174829.437795:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174829.437797:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.437820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145182336:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174829.437821:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8563
00000100:00080000:2.0:1786174829.437834:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174829.437838:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174829.437843:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174829.437852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145182464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174829.437860:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145183360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786174829.438001:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174829.438030:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87d880 x1872931145182464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174829.438044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145182464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174829.438053:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174829.438056:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.438060:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145182464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174829.438088:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145182592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174829.438109:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174829.438119:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87d500 x1872931145182592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174829.438130:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145182592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174829.438138:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174829.438141:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.438144:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145182592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174829.438149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145182720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174829.438164:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174829.438171:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87e680 x1872931145182720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174829.438181:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145182720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174829.438189:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174829.438192:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.438194:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145182720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174829.438199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145182848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174829.438213:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174829.438220:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87c380 x1872931145182848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174829.438250:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145182848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174829.438260:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174829.438263:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.438267:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145182848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174829.438274:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145182976:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174829.438294:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174829.438305:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87c700 x1872931145182976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174829.438319:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145182976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174829.438328:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174829.438331:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.438336:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145182976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174829.438343:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145183104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174829.438361:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174829.438372:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87ca80 x1872931145183104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174829.438385:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145183104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174829.438394:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174829.438398:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.438401:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145183104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174829.438408:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145183232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174829.438426:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174829.438436:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87df80 x1872931145183232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174829.438481:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145183232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174829.438495:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174829.438502:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.438509:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145183232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174829.438522:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145183360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174829.438563:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174829.438587:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174829/real 1786174829]  req@ffff89d99e87f800 x1872931145183360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174829.438625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145183360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174829.438633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174829.438636:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174829.438639:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145183360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174829.949089:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174829.949174:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174830.461043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174830.973057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174830.973149:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174831.485056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174831.997066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174831.997200:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174832.509035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174833.021061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174833.021103:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174833.533050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174834.045042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174834.045227:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174834.557050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174834.557082:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174834.557093:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174834.557099:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174834.557113:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00080000:0.0:1786174834.557124:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174834.557134:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174834.557220:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145183488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174834.557276:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174834.557285:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174834.557288:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174834.557297:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00080000:0.0:1786174834.557305:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174834.557312:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174834.557325:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174834.557351:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145183616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174834.557360:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145183488:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174834.557413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174834.557420:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174834.557424:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174834.557434:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00080000:0.0:1786174834.557443:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174834.557450:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174834.557459:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174834.557486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145183744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174834.557487:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174834.557507:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174834.557523:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174834.557527:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174834.557535:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00080000:0.0:1786174834.557544:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174834.557552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f1880 x1872931145183488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174834.557553:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174834.557569:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174834.557601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145183488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174834.557603:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145183872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174834.557657:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174834.557659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174834.557671:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174834.557675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174834.557677:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174834.557689:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145183488:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174834.557691:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00080000:0.0:1786174834.557706:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174834.557713:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174834.557720:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174834.557739:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145183616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174834.557742:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145184000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174834.557772:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786174834.557783:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174834.557784:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174834.557794:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174834.557808:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00100000:2.0:1786174834.557811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f0700 x1872931145183616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174834.557823:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174834.557839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145183616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174834.557844:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174834.557863:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786174834.557865:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174834.557875:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174834.557880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145183616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174834.557891:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145184128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174834.557940:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145183744:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174834.557957:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174834.557964:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174834.557968:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174834.557977:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00080000:0.0:1786174834.557988:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786174834.557997:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174834.558005:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174834.558016:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174834.558033:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f1500 x1872931145183744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174834.558041:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145184256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174834.558074:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174834.558082:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145183744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174834.558084:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174834.558091:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174834.558109:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00080000:2.0:1786174834.558114:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174834.558118:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174834.558127:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174834.558135:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174834.558143:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145183744:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786174834.558151:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174834.558157:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145183872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174834.558186:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145184384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174834.558214:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174834.558235:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174834.558236:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f3b80 x1872931145183872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174834.558256:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174834.558264:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174834.558271:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145183872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174834.558280:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8568
00000100:00080000:2.0:1786174834.558287:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174834.558292:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174834.558297:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174834.558307:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174834.558308:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145183872:192.168.202.130@tcp:8:kworker.0
00000008:00100000:0.0:1786174834.558344:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174834.558364:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145184000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174834.558375:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145184512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174834.558451:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174834.558474:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f2d80 x1872931145184000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174834.558502:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145184000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174834.558512:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174834.558517:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174834.558524:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145184000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174834.558538:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145184128:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174834.558565:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174834.558579:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f3480 x1872931145184128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174834.558594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145184128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174834.558604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174834.558607:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174834.558610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145184128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174834.558616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145184256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174834.558633:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174834.558643:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f2680 x1872931145184256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174834.558675:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145184256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174834.558693:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174834.558697:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174834.558701:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145184256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174834.558708:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145184384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174834.558727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174834.558738:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f2a00 x1872931145184384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174834.558751:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145184384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174834.558761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174834.558765:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174834.558768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145184384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174834.558787:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145184512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174834.558807:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174834.558818:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174834/real 1786174834]  req@ffff89d9870f0e00 x1872931145184512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174834.558831:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145184512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174834.558842:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174834.558845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174834.558850:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145184512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174835.069047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174835.069144:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174835.581029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174836.093044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174836.093154:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174836.605003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174837.117038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174837.117162:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174837.629025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174838.140998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174838.141068:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174838.653059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174839.165075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174839.165201:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786174839.677002:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174839.677008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174839.677011:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174839.677017:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174839.677026:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8573
00000100:00080000:0.0:1786174839.677034:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174839.677040:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174839.677082:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145184640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174839.677104:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174839.677108:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174839.677109:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174839.677112:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8573
00000100:00080000:0.0:1786174839.677134:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174839.677137:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174839.677147:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174839.677147:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145184640:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786174839.677164:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145184768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174839.677172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174839.677175:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174839.677177:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174839.677180:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8573
00000100:00080000:0.0:1786174839.677183:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174839.677185:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174839.677189:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174839.677199:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145184896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174839.677205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174839.677210:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:2.0:1786174839.677211:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174839.677212:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174839.677217:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8573
00000100:00080000:0.0:1786174839.677220:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174839.677223:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174839.677228:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174839.677237:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145185024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174839.677244:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174839.677247:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174839.677250:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174839.677251:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f1180 x1872931145184640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174839.677255:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8573
00000100:00080000:0.0:1786174839.677261:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174839.677266:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174839.677271:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174839.677275:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145184640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174839.677282:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145185152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174839.677287:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174839.677292:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174839.677296:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174839.677298:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174839.677301:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174839.677302:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145184640:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174839.677307:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8573
00000100:00080000:0.0:1786174839.677311:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174839.677314:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174839.677317:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174839.677323:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145185280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174839.677328:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145184768:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174839.677336:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174839.677365:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174839.677370:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786174839.677370:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174839.677378:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8573
00000100:00080000:0.0:1786174839.677383:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174839.677387:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f0a80 x1872931145184768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174839.677388:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174839.677396:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174839.677404:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145184768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174839.677410:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145185408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174839.677422:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174839.677425:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174839.677430:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174839.677432:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174839.677433:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174839.677440:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8573
00000100:00100000:2.0:1786174839.677444:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145184768:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174839.677445:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174839.677451:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174839.677457:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174839.677465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145184896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174839.677475:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145185536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174839.677483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174839.677486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174839.677487:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174839.677492:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8573
00000800:00000100:2.0:1786174839.677492:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174839.677499:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174839.677503:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174839.677508:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174839.677511:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f3100 x1872931145184896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174839.677520:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145185664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174839.677527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145184896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174839.677538:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174839.677541:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174839.677544:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145184896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174839.677549:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145185024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174839.677562:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174839.677569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f0e00 x1872931145185024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174839.677576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145185024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174839.677581:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174839.677583:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174839.677585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145185024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174839.677589:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145185152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174839.677600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174839.677606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f2a00 x1872931145185152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174839.677614:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145185152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174839.677619:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174839.677620:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174839.677622:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145185152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174839.677635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145185280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174839.677646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174839.677652:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f2680 x1872931145185280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174839.677660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145185280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174839.677665:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174839.677667:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174839.677669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145185280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174839.677672:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145185408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174839.677682:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174839.677688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f3480 x1872931145185408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174839.677695:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145185408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174839.677705:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174839.677707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174839.677709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145185408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174839.677713:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145185536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174839.677722:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174839.677728:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f2d80 x1872931145185536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174839.677735:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145185536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174839.677741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174839.677743:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174839.677745:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145185536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174839.677749:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145185664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174839.677758:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174839.677763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174839/real 1786174839]  req@ffff89d9870f3b80 x1872931145185664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174839.677771:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145185664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174839.677776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174839.677778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174839.677780:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145185664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174840.189114:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174840.189120:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174840.700976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174841.212996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174841.213039:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174841.725008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174842.237096:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174842.237189:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174842.749041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174843.261058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174843.261334:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174843.773019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174844.285011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174844.285066:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786174844.797034:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174844.797038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174844.797050:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174844.797055:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797066:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8579
00000100:00080000:0.0:1786174844.797077:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174844.797085:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174844.797126:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145185792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174844.797158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174844.797163:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174844.797165:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797169:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8579
00000100:00080000:0.0:1786174844.797172:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174844.797177:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174844.797187:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174844.797206:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145185920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174844.797206:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145185792:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174844.797228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174844.797232:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174844.797234:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797238:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8579
00000100:00080000:0.0:1786174844.797243:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174844.797248:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174844.797254:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174844.797267:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145186048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174844.797278:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174844.797282:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174844.797284:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797287:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8579
00000100:00080000:0.0:1786174844.797313:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174844.797317:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174844.797324:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786174844.797326:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174844.797344:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145186176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174844.797359:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174844.797365:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174844.797368:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797376:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8579
00000100:00100000:2.0:1786174844.797384:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f1500 x1872931145185792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174844.797385:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174844.797400:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174844.797411:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174844.797417:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145185792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174844.797434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786174844.797440:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145186304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174844.797442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174844.797453:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145185792:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174844.797475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174844.797480:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174844.797483:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797488:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8579
00000100:00080000:0.0:1786174844.797494:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174844.797501:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145185920:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174844.797502:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174844.797513:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174844.797531:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145186432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174844.797543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174844.797548:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174844.797550:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797559:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8579
00000800:00000100:2.0:1786174844.797562:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174844.797565:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174844.797572:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174844.797578:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174844.797590:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f0700 x1872931145185920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174844.797596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145186560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174844.797629:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174844.797635:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145185920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174844.797636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174844.797641:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797652:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8579
00000100:00080000:0.0:1786174844.797661:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174844.797662:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174844.797668:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786174844.797675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786174844.797679:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174844.797684:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145185920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174844.797697:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145186688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174844.797700:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145186048:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174844.797718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174844.797721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174844.797723:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174844.797729:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8579
00000100:00080000:0.0:1786174844.797733:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174844.797736:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174844.797740:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174844.797754:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145186816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174844.797774:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174844.797805:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f1880 x1872931145186048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174844.797833:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145186048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174844.797843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174844.797846:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174844.797850:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145186048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174844.797857:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145186176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174844.797881:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174844.797892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f3b80 x1872931145186176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174844.797943:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145186176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174844.797956:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174844.797961:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174844.797966:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145186176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174844.797973:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145186304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174844.797998:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174844.798011:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f2d80 x1872931145186304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174844.798023:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145186304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174844.798031:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174844.798033:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174844.798036:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145186304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174844.798055:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145186432:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174844.798072:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174844.798082:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f3480 x1872931145186432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174844.798093:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145186432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174844.798101:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174844.798104:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174844.798106:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145186432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174844.798112:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145186560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174844.798127:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174844.798136:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f2680 x1872931145186560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174844.798147:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145186560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174844.798155:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174844.798158:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174844.798161:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145186560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174844.798167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145186688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174844.798181:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174844.798189:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f2a00 x1872931145186688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174844.798200:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145186688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174844.798209:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174844.798211:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174844.798214:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145186688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174844.798220:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145186816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174844.798234:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174844.798243:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174844/real 1786174844]  req@ffff89d9870f0e00 x1872931145186816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174844.798254:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145186816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174844.798261:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174844.798264:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174844.798267:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145186816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174845.309019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174845.309077:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174845.821045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174846.333117:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174846.333145:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174846.845026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174847.357142:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174847.357283:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174847.869071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174848.381057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174848.381142:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174848.893055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174849.405015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174849.405136:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174849.917065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786174849.917112:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174849.917129:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786174849.917136:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174849.917150:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8584
00000100:00080000:1.0:1786174849.917165:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174849.917177:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174849.917233:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145186944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174849.917292:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174849.917297:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174849.917300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174849.917305:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8584
00000100:00080000:1.0:1786174849.917310:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174849.917316:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174849.917330:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174849.917351:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145186944:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786174849.917353:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145187072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174849.917376:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174849.917380:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174849.917382:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174849.917387:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8584
00000100:00080000:1.0:1786174849.917390:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174849.917394:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174849.917400:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174849.917415:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145187200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174849.917429:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174849.917433:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174849.917436:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174849.917439:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8584
00000800:00000100:2.0:1786174849.917447:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786174849.917448:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174849.917456:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174849.917464:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174849.917478:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145187328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174849.917489:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174849.917494:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174849.917497:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174849.917521:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2ff100 x1872931145186944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174849.917527:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8584
00000100:00080000:1.0:1786174849.917538:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174849.917550:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174849.917559:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174849.917566:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145186944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174849.917579:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145187456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174849.917607:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174849.917619:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174849.917625:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174849.917629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145186944:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786174849.917642:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174849.917650:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174849.917660:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8584
00000100:00080000:1.0:1786174849.917670:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174849.917672:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145187072:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174849.917703:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174849.917716:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174849.917735:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174849.917764:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145187584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174849.917777:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2fc380 x1872931145187072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174849.917803:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174849.917810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145187072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174849.917816:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174849.917825:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174849.917830:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174849.917840:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8584
00000100:00080000:2.0:1786174849.917840:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174849.917853:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145187072:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174849.917856:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174849.917863:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145187200:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174849.917869:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174849.917879:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174849.917899:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174849.917904:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145187712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174849.917919:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174849.917924:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174849.917929:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174849.917931:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2fdf80 x1872931145187200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174849.917937:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8584
00000100:00080000:1.0:1786174849.917947:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174849.917958:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174849.918005:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174849.918023:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145187840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174849.918034:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145187200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174849.918088:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174849.918091:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174849.918097:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174849.918100:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786174849.918107:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145187200:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174849.918108:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174849.918124:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8584
00000100:00100000:2.0:1786174849.918130:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145187328:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786174849.918131:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174849.918145:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174849.918152:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174849.918166:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145187968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174849.918193:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174849.918213:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2ffb80 x1872931145187328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174849.918228:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145187328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174849.918237:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174849.918317:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174849.918322:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145187328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174849.918330:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145187456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174849.918358:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174849.918373:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2fe300 x1872931145187456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174849.918386:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145187456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174849.918396:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174849.918399:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174849.918403:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145187456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174849.918426:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145187584:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174849.918446:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174849.918456:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2fd500 x1872931145187584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174849.918470:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145187584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174849.918479:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174849.918482:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174849.918486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145187584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174849.918509:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145187712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174849.918529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174849.918541:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2fea00 x1872931145187712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174849.918554:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145187712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174849.918565:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174849.918568:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174849.918572:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145187712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174849.918579:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145187840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174849.918613:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174849.918624:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2ff100 x1872931145187840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174849.918636:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145187840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174849.918645:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174849.918649:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174849.918652:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145187840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174849.918658:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145187968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174849.918675:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174849.918708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174849/real 1786174849]  req@ffff89d9ba2fd180 x1872931145187968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174849.918722:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145187968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174849.918732:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174849.918735:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174849.918740:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145187968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174850.429000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174850.429064:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174850.941004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174851.453032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174851.453184:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174851.965050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174852.477051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174852.477134:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174852.989039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174853.501006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174853.501101:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174854.013030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174854.525065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174854.525161:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174855.037035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786174855.037049:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174855.037060:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786174855.037067:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174855.037079:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.037091:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174855.037101:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174855.037149:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145188096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174855.037185:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174855.037214:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174855.037219:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174855.037226:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.037233:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174855.037240:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174855.037254:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174855.037264:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145188096:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786174855.037291:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145188224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174855.037310:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174855.037315:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174855.037317:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174855.037323:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.037328:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174855.037333:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174855.037341:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174855.037354:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174855.037371:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145188352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174855.037387:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174855.037392:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174855.037394:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174855.037399:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.037405:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174855.037410:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174855.037418:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174855.037432:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2fce00 x1872931145188096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174855.037437:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145188480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174855.037500:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174855.037505:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174855.037508:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174855.037513:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.037518:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174855.037521:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145188096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174855.037528:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174855.037539:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786174855.037558:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786174855.037561:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145188608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174855.037572:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174855.037588:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174855.037589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145188096:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786174855.037605:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174855.037611:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174855.037621:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.037628:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174855.037640:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174855.037650:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174855.037656:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145188224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174855.037676:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145188736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174855.037702:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786174855.037703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786174855.037716:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174855.037721:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174855.037730:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2ff480 x1872931145188224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174855.037733:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.037745:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174855.037759:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174855.037774:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174855.037780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145188224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174855.037803:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786174855.037807:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145188864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174855.037821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174855.037839:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145188224:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174855.037843:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174855.037857:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174855.037861:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174855.037865:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145188352:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174855.037874:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.037884:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174855.037893:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786174855.037950:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786174855.037962:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174855.037985:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2fd880 x1872931145188352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174855.037996:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145188992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174855.038044:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174855.038050:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786174855.038056:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145188352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174855.038057:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174855.038074:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8589
00000100:00080000:1.0:1786174855.038086:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174855.038089:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174855.038097:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786174855.038103:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786174855.038110:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174855.038113:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145188352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174855.038129:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145188480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174855.038137:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145189120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174855.038175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174855.038221:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2fc700 x1872931145188480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174855.038238:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145188480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174855.038249:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174855.038253:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174855.038257:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145188480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174855.038265:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145188608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174855.038291:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174855.038305:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2fed80 x1872931145188608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174855.038320:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145188608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174855.038330:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174855.038333:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174855.038337:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145188608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174855.038363:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145188736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174855.038396:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174855.038417:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2fdc00 x1872931145188736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174855.038442:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145188736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174855.038460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174855.038466:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174855.038473:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145188736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174855.038484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145188864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174855.038513:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174855.038528:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2ff800 x1872931145188864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174855.038542:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145188864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174855.038553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174855.038557:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174855.038561:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145188864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174855.038568:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145188992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174855.038586:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174855.038596:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2fe680 x1872931145188992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174855.038610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145188992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174855.038621:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174855.038624:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174855.038628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145188992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174855.038635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145189120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174855.038652:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174855.038662:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174855/real 1786174855]  req@ffff89d9ba2fce00 x1872931145189120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174855.038676:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145189120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174880 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174855.038685:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174855.038688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174855.038693:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145189120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174855.549004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174855.549101:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174856.061178:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174856.573043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174856.573262:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174857.085070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174857.597014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174857.597079:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174858.109019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174858.621085:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174858.621143:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174859.132993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174859.645072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174859.645131:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174860.157031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174860.157063:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157074:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174860.157082:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174860.157097:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157111:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174860.157124:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174860.157218:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145189248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174860.157253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157258:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174860.157261:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174860.157266:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157271:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174860.157276:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174860.157289:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174860.157305:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145189376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174860.157321:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145189248:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174860.157325:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157338:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174860.157341:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174860.157348:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157353:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174860.157358:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174860.157364:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174860.157383:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145189504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174860.157396:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157401:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174860.157404:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174860.157407:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157412:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174860.157417:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174860.157422:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174860.157440:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145189632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174860.157460:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157467:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174860.157470:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174860.157478:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157487:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174860.157488:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145189376:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174860.157502:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174860.157516:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174860.157541:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145189760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174860.157561:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157567:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174860.157570:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174860.157577:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157585:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174860.157590:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145189504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174860.157599:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174860.157614:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174860.157637:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145189888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174860.157656:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145189632:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786174860.157659:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157674:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174860.157678:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174860.157687:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157708:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174860.157718:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174860.157731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145189760:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786174860.157731:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174860.157781:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145190016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174860.157798:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157803:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174860.157805:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174860.157812:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145189888:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174860.157812:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157823:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174860.157832:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174860.157841:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174860.157865:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145190016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174860.157865:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145190144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174860.157894:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174860.157898:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174860.157900:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174860.157904:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8594
00000100:00080000:3.0:1786174860.157909:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174860.157955:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174860.157966:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174860.157992:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145190272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174860.157995:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145190144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174860.158069:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145190272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174860.669050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174860.669155:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174861.181154:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174861.693046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174861.693212:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174862.205142:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174862.716986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174862.717092:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174863.229274:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786174863.229376:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786174863.229429:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786174863.229449:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174863.229513:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786174863.229544:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174863.229564:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174863.229581:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786174863.229584:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe66a00 x1872931145190272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786174863.229598:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786174863.229622:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786174863.229628:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145190272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786174863.229642:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786174863.229645:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.229657:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000800:00000100:0.0:1786174863.229664:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786174863.229671:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145190272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174863.229687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe67480 x1872931145190144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174863.229733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145190144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174863.229748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.229754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174863.229759:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145190144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174863.229769:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe64a80 x1872931145190016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174863.229790:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145190016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174863.229803:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.229808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174863.229813:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145190016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174863.229823:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe64700 x1872931145189760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174863.229840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145189760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174863.229851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.229856:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174863.229860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145189760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174863.229868:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe65500 x1872931145189888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174863.229885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145189888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174863.229925:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.229930:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174863.229936:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145189888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174863.229948:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe65880 x1872931145189376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174863.229968:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145189376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174863.229981:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.229986:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174863.229990:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145189376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174863.229998:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe66300 x1872931145189504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174863.230014:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145189504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174863.230023:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.230028:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174863.230031:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145189504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174863.230040:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe64000 x1872931145189632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174863.230055:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145189632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174863.230064:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.230068:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174863.230072:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145189632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174863.230080:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174860/real 1786174863]  req@ffff89d99fe67100 x1872931145189248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174863.230096:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145189248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174863.230105:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174863.230133:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174863.230140:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145189248:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786174863.741024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174863.741165:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174864.253121:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174864.765062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174864.765116:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174865.277027:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786174865.277038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174865.277045:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174865.277052:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174865.277062:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8599
00000100:00080000:3.0:1786174865.277073:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174865.277082:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174865.277147:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145190400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174865.277178:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174865.277182:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174865.277184:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174865.277188:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8599
00000100:00080000:3.0:1786174865.277192:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174865.277197:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174865.277208:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174865.277221:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145190400:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786174865.277230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145190528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174865.277250:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174865.277255:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174865.277259:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174865.277265:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8599
00000100:00080000:3.0:1786174865.277272:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174865.277278:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174865.277287:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786174865.277295:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174865.277310:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145190656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174865.277324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174865.277328:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174865.277330:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174865.277335:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8599
00000100:00080000:3.0:1786174865.277341:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174865.277342:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe67b80 x1872931145190400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174865.277349:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174865.277363:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174865.277374:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145190400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174865.277382:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145190784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174865.277400:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174865.277404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174865.277410:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174865.277412:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174865.277416:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174865.277420:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145190400:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174865.277426:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8599
00000100:00080000:3.0:1786174865.277432:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174865.277436:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174865.277440:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174865.277450:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145190912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174865.277455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145190528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174865.277475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174865.277479:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174865.277482:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174865.277486:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8599
00000800:00000100:1.0:1786174865.277492:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174865.277493:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174865.277502:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174865.277510:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174865.277515:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe66680 x1872931145190528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174865.277527:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145191040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174865.277537:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145190528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174865.277588:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174865.277590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174865.277596:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174865.277598:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174865.277604:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174865.277607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145190528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174865.277613:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8599
00000100:00080000:3.0:1786174865.277619:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174865.277623:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145190656:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174865.277627:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174865.277638:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174865.277654:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145191168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174865.277668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786174865.277674:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174865.277679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174865.277685:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174865.277692:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8599
00000100:00080000:3.0:1786174865.277701:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174865.277702:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe66d80 x1872931145190656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174865.277714:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174865.277730:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174865.277740:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145190656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174865.277754:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145191296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174865.277758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174865.277773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174865.277785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145190656:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174865.277790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174865.277800:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786174865.277805:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145190784:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786174865.277806:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174865.277822:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8599
00000100:00080000:3.0:1786174865.277830:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174865.277837:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174865.277845:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174865.277854:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174865.277867:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145191424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174865.277880:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe64380 x1872931145190784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174865.277955:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145190784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174865.277979:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174865.277986:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174865.277992:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145190784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174865.278021:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145190912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174865.278057:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174865.278075:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe65180 x1872931145190912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174865.278125:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145190912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174865.278138:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174865.278143:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174865.278149:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145190912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174865.278159:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145191040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174865.278189:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174865.278206:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe67800 x1872931145191040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174865.278223:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145191040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174865.278235:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174865.278239:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174865.278245:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145191040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174865.278255:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145191168:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174865.278285:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174865.278304:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe65f80 x1872931145191168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174865.278322:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145191168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174865.278333:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174865.278337:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174865.278341:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145191168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174865.278350:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145191296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174865.278381:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174865.278399:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe67b80 x1872931145191296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174865.278418:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145191296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174865.278431:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174865.278437:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174865.278442:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145191296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174865.278452:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145191424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174865.278483:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174865.278512:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174865/real 1786174865]  req@ffff89d99fe67100 x1872931145191424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174865.278528:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145191424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174865.278542:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174865.278547:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174865.278552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145191424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174865.788986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174865.789040:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174866.301250:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174866.813019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174866.813157:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174867.325016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174867.837020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174867.837189:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174868.349094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174868.861050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174868.861218:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174869.373104:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174869.885060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174869.885192:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174870.397030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174870.397148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174870.397158:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174870.397165:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174870.397178:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00080000:3.0:1786174870.397189:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174870.397207:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174870.397252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145191552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174870.397289:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174870.397294:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174870.397297:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174870.397305:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00080000:3.0:1786174870.397310:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174870.397317:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174870.397330:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174870.397349:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145191680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174870.397356:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145191552:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174870.397382:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174870.397387:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174870.397390:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174870.397398:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00080000:3.0:1786174870.397402:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174870.397407:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174870.397413:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174870.397429:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145191808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174870.397442:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174870.397447:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174870.397453:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786174870.397454:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174870.397463:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00100000:2.0:1786174870.397509:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe64000 x1872931145191552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174870.397532:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145191552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174870.397546:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174870.397551:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174870.397557:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145191552:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174870.397567:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174870.397578:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174870.397587:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174870.397595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145191680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174870.397611:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145191936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174870.397629:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786174870.397635:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174870.397638:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174870.397644:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174870.397652:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00080000:3.0:1786174870.397659:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174870.397661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe66300 x1872931145191680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174870.397673:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174870.397687:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174870.397699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145191680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174870.397709:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145192064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174870.397722:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174870.397740:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174870.397749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174870.397755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145191680:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174870.397762:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174870.397770:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174870.397778:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145191808:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174870.397787:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00080000:3.0:1786174870.397798:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174870.397809:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174870.397820:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174870.397834:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174870.397857:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe65880 x1872931145191808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174870.397872:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145191808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174870.397883:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174870.397886:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174870.397890:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145191808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174870.397955:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145191936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174870.397996:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174870.398025:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe65500 x1872931145191936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174870.398085:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145191936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174870.398104:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786174870.398113:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145192192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174870.398115:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174870.398132:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145191936:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786174870.398143:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174870.398151:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145192064:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786174870.398154:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174870.398164:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174870.398172:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00080000:3.0:1786174870.398181:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174870.398187:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174870.398197:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174870.398204:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174870.398227:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145192320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174870.398241:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe64700 x1872931145192064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174870.398259:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145192064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174870.398269:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174870.398273:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174870.398276:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145192064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174870.398295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145192192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174870.398317:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174870.398328:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe64a80 x1872931145192192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174870.398341:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145192192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174870.398358:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174870.398362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174870.398367:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145192192:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174870.398424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174870.398430:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174870.398433:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174870.398441:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00080000:3.0:1786174870.398450:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174870.398458:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174870.398468:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174870.398490:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145192320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174870.398493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145192448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174870.398517:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174870.398522:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174870.398525:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174870.398531:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8604
00000100:00080000:3.0:1786174870.398539:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174870.398543:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174870.398549:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174870.398584:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145192576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786174870.398604:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174870.398636:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe67480 x1872931145192320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174870.398658:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145192320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174870.398670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174870.398675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174870.398680:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145192320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174870.398700:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145192448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174870.398729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174870.398743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe66a00 x1872931145192448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174870.398767:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145192448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174870.398778:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174870.398783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174870.398789:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145192448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174870.398801:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145192576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174870.398851:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174870.398871:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174870/real 1786174870]  req@ffff89d99fe64a80 x1872931145192576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174870.398977:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145192576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174870.398995:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174870.399003:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174870.399009:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145192576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174870.909092:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174870.909191:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174871.421025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174871.933019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174871.933237:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174872.445040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174872.957140:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174872.957195:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174873.469031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174873.981004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174873.981173:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786174874.493047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174875.005088:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174875.005194:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786174875.517073:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174875.517086:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786174875.517092:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174875.517097:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786174875.517106:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517118:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517129:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174875.517168:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145192704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174875.517200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174875.517204:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174875.517206:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174875.517209:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517212:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517216:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174875.517224:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174875.517235:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145192832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174875.517246:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174875.517250:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:2.0:1786174875.517253:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145192704:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786174875.517254:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174875.517263:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517267:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517270:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174875.517274:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174875.517286:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145192960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174875.517300:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174875.517303:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174875.517304:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174875.517307:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517311:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517314:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174875.517318:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786174875.517324:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174875.517332:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145193088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174875.517342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174875.517345:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174875.517346:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174875.517350:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517353:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517356:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174875.517361:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174875.517366:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2fd180 x1872931145192704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174875.517373:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145193216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174875.517385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174875.517387:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174875.517389:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174875.517408:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517412:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517419:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174875.517420:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145192704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786174875.517423:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174875.517436:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145193344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174875.517438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.517449:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174875.517455:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174875.517458:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145192704:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786174875.517459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174875.517465:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174875.517470:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517473:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517476:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174875.517480:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174875.517488:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145193472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174875.517494:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145192832:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174875.517501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174875.517505:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174875.517507:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174875.517512:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517514:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517518:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174875.517522:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174875.517532:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145193600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174875.517540:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786174875.517553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174875.517564:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2ff100 x1872931145192832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174875.517569:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174875.517573:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174875.517583:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8609
00000100:00080000:1.0:1786174875.517590:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174875.517592:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174875.517596:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174875.517604:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145192832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174875.517619:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145193728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174875.517628:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.517637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174875.517642:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145192832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174875.517650:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145192960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174875.517672:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174875.517681:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2fea00 x1872931145192960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174875.517691:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145192960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174875.517699:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.517702:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174875.517705:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145192960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174875.517709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145193088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174875.517733:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174875.517740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2fd500 x1872931145193088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174875.517750:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145193088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174875.517756:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.517758:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174875.517761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145193088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174875.517765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145193216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174875.517777:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174875.517796:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2fe300 x1872931145193216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174875.517806:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145193216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174875.517812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.517814:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174875.517817:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145193216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174875.517829:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145193344:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174875.517843:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174875.517861:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2ffb80 x1872931145193344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174875.517871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145193344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174875.517896:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.517900:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174875.517903:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145193344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174875.517981:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145193472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174875.518052:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174875.518063:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2fdf80 x1872931145193472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174875.518074:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145193472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174875.518086:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.518089:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174875.518092:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145193472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174875.518097:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145193600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174875.518111:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174875.518118:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2fc380 x1872931145193600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174875.518128:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145193600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174875.518134:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.518136:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174875.518139:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145193600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174875.518143:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145193728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174875.518155:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174875.518162:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174875/real 1786174875]  req@ffff89d9ba2fd180 x1872931145193728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174875.518172:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145193728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174875.518178:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174875.518180:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174875.518183:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145193728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174876.029082:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174876.029214:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174876.541071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174877.053129:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174877.053204:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174877.565056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174878.077017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174878.077020:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174878.589023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174879.101052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174879.101147:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174879.613044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174880.125039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174880.125144:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174880.637047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174880.637084:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174880.637095:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174880.637101:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174880.637116:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8614
00000100:00080000:0.0:1786174880.637127:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174880.637137:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174880.637182:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145193856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174880.637220:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174880.637225:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174880.637228:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174880.637233:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8614
00000100:00080000:0.0:1786174880.637237:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174880.637241:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174880.637253:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174880.637270:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145193984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174880.637287:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174880.637294:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145193856:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174880.637297:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174880.637307:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174880.637319:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8614
00000100:00080000:0.0:1786174880.637327:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174880.637335:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174880.637347:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174880.637375:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145194112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786174880.637387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174880.637405:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174880.637411:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174880.637414:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174880.637421:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8614
00000100:00080000:0.0:1786174880.637429:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174880.637436:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174880.637447:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f3100 x1872931145193856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786174880.637466:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174880.637480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145193856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174880.637493:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145194240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174880.637504:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174880.637517:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174880.637519:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174880.637527:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786174880.637534:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145193856:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174880.637535:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174880.637551:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8614
00000100:00080000:0.0:1786174880.637557:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174880.637562:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174880.637567:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174880.637583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145193984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174880.637592:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145194368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174880.637610:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174880.637615:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174880.637618:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786174880.637624:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174880.637632:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8614
00000100:00080000:0.0:1786174880.637641:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174880.637647:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174880.637654:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174880.637655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f0a80 x1872931145193984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174880.637679:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145194496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174880.637684:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145193984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174880.637729:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174880.637741:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174880.637742:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174880.637753:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145193984:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174880.637754:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174880.637761:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174880.637772:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8614
00000100:00100000:2.0:1786174880.637775:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145194112:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174880.637779:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174880.637790:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174880.637797:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786174880.637813:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174880.637819:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145194624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174880.637835:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f1180 x1872931145194112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174880.637836:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174880.637853:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174880.637860:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174880.637880:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8614
00000100:00100000:2.0:1786174880.637882:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145194112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174880.637893:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174880.637973:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174880.637983:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174880.637989:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174880.637997:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145194112:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786174880.638004:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174880.638014:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145194240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174880.638032:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145194752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174880.638048:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174880.638053:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174880.638057:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174880.638063:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8614
00000800:00000100:2.0:1786174880.638074:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174880.638076:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174880.638087:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174880.638095:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174880.638114:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f0e00 x1872931145194240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174880.638116:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145194880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174880.638181:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145194240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174880.638200:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174880.638208:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174880.638215:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145194240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174880.638244:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145194368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174880.638276:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174880.638291:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f2a00 x1872931145194368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174880.638306:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145194368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174880.638317:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174880.638321:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174880.638325:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145194368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174880.638332:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145194496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174880.638351:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174880.638362:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f2680 x1872931145194496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174880.638377:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145194496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174880.638387:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174880.638390:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174880.638393:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145194496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174880.638400:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145194624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174880.638418:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174880.638428:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f3480 x1872931145194624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174880.638441:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145194624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174880.638452:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174880.638455:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174880.638460:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145194624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174880.638467:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145194752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174880.638485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174880.638496:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f2d80 x1872931145194752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174880.638509:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145194752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174880.638520:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174880.638524:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174880.638528:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145194752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174880.638535:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145194880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174880.638553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174880.638563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174880/real 1786174880]  req@ffff89d9870f3b80 x1872931145194880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174880.638577:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145194880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174880.638587:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174880.638590:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174880.638594:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145194880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174881.149055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174881.149238:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174881.661024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174882.173022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174882.173064:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174882.684985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174883.197083:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174883.197151:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174883.709079:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174884.221027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174884.221140:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174884.733052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174885.245037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174885.245207:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174885.756983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174885.757010:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174885.757017:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174885.757021:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174885.757029:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00080000:2.0:1786174885.757037:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174885.757043:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174885.757087:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145195008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174885.757111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174885.757114:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174885.757115:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174885.757118:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00080000:2.0:1786174885.757120:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174885.757123:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174885.757129:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174885.757138:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145195136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174885.757163:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174885.757167:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174885.757169:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174885.757172:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00080000:2.0:1786174885.757175:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174885.757179:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174885.757183:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174885.757195:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145195008:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786174885.757196:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145195264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174885.757232:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174885.757235:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174885.757236:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174885.757238:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00080000:2.0:1786174885.757241:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174885.757243:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174885.757247:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174885.757257:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145195392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174885.757263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174885.757266:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174885.757267:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174885.757270:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00080000:2.0:1786174885.757272:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174885.757274:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174885.757277:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174885.757286:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145195520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786174885.757287:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174885.757296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174885.757299:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174885.757300:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174885.757303:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00080000:2.0:1786174885.757306:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174885.757309:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174885.757312:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174885.757320:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145195648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174885.757326:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174885.757328:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174885.757331:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174885.757332:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87ed80 x1872931145195008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174885.757336:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00080000:2.0:1786174885.757342:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174885.757347:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174885.757357:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145195008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786174885.757360:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174885.757375:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145195776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174885.757377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174885.757386:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174885.757389:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786174885.757390:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174885.757393:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174885.757398:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00100000:1.0:1786174885.757399:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145195008:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174885.757401:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174885.757407:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174885.757411:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174885.757416:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145195136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174885.757422:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145195904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174885.757434:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174885.757437:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174885.757438:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174885.757441:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8619
00000100:00080000:2.0:1786174885.757444:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786174885.757448:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174885.757449:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174885.757454:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174885.757463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87c000 x1872931145195136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174885.757468:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145196032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174885.757483:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145195136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174885.757493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174885.757496:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174885.757498:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145195136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174885.757522:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145195264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174885.757534:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174885.757541:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87dc00 x1872931145195264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174885.757549:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145195264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174885.757555:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174885.757557:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174885.757559:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145195264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174885.757563:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145195392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174885.757573:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174885.757579:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87f800 x1872931145195392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174885.757605:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145195392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174885.757612:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174885.757614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174885.757616:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145195392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174885.757621:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145195520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174885.757634:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174885.757641:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87df80 x1872931145195520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174885.757651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145195520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174885.757657:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174885.757659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174885.757661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145195520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174885.757666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145195648:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174885.757677:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174885.757684:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87ca80 x1872931145195648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174885.757694:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145195648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174885.757710:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174885.757726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174885.757729:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145195648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174885.757734:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145195776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174885.757748:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174885.757757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87c700 x1872931145195776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174885.757773:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145195776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174885.757780:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174885.757783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174885.757801:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145195776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174885.757806:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145195904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174885.757818:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174885.757824:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87c380 x1872931145195904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174885.757831:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145195904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174885.757841:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174885.757843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174885.757845:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145195904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174885.757849:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145196032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174885.757858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174885.757864:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174885/real 1786174885]  req@ffff89d99e87e680 x1872931145196032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174885.757871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145196032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174885.757876:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174885.757878:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174885.757880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145196032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174886.269012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174886.269094:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174886.781002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174887.293006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174887.293066:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174887.805007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174888.317070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174888.317115:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174888.829001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174889.341047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174889.341124:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174889.852990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174890.365123:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174890.365321:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174890.877072:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174890.877109:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174890.877128:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174890.877137:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174890.877158:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8625
00000100:00080000:2.0:1786174890.877179:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174890.877194:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174890.877282:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145196160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174890.877344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174890.877349:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174890.877352:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174890.877357:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8625
00000100:00080000:2.0:1786174890.877362:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174890.877367:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174890.877385:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174890.877405:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145196288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174890.877420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174890.877428:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145196160:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174890.877430:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174890.877440:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174890.877462:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8625
00000100:00080000:2.0:1786174890.877466:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174890.877471:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174890.877479:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174890.877497:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145196416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174890.877512:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174890.877517:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174890.877519:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174890.877524:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8625
00000100:00080000:2.0:1786174890.877532:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174890.877536:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174890.877544:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174890.877555:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174890.877573:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145196544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174890.877587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174890.877593:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174890.877597:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174890.877605:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8625
00000100:00080000:2.0:1786174890.877614:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174890.877627:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174890.877629:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87d500 x1872931145196160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786174890.877640:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174890.877673:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145196672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174890.877678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145196160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174890.877745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174890.877757:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786174890.877763:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174890.877766:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145196160:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174890.877786:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174890.877793:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174890.877803:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8625
00000100:00100000:1.0:1786174890.877828:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145196288:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786174890.877829:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174890.877878:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174890.877893:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786174890.877948:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174890.877974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87d880 x1872931145196288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174890.877988:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145196800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174890.878002:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145196288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174890.878068:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174890.878071:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174890.878077:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174890.878088:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145196288:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786174890.878092:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174890.878101:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174890.878109:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145196416:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786174890.878110:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8625
00000100:00080000:2.0:1786174890.878130:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174890.878142:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174890.878156:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786174890.878157:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174890.878175:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87f100 x1872931145196416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174890.878197:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145196928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174890.878220:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145196416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174890.878257:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174890.878265:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786174890.878271:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174890.878273:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145196416:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786174890.878293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786174890.878294:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145196544:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786174890.878305:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174890.878322:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8625
00000800:00000100:1.0:1786174890.878345:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174890.878358:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174890.878367:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87e680 x1872931145196544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174890.878377:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174890.878403:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145196544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786174890.878405:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786174890.878430:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174890.878438:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174890.878445:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145197056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174890.878453:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145196544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174890.878497:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145196672:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786174890.878497:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174890.878530:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174890.878535:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174890.878547:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8625
00000100:00080000:2.0:1786174890.878556:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786174890.878567:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174890.878574:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174890.878584:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174890.878600:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87c380 x1872931145196672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174890.878608:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145197184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174890.878690:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145196672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174890.878704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174890.878710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174890.878715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145196672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174890.878753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145196800:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174890.878776:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174890.878788:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87c700 x1872931145196800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174890.878804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145196800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174890.878814:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174890.878817:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174890.878821:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145196800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174890.878828:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145196928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174890.878877:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174890.878891:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87ca80 x1872931145196928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174890.878937:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145196928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174890.878947:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174890.878951:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174890.878955:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145196928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174890.878964:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145197056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174890.878988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174890.879001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87df80 x1872931145197056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174890.879015:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145197056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174890.879034:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174890.879038:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174890.879042:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145197056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174890.879049:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145197184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174890.879066:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174890.879077:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174890/real 1786174890]  req@ffff89d99e87f800 x1872931145197184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174890.879091:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145197184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174890.879101:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174890.879104:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174890.879108:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145197184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174891.389003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174891.389095:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174891.901010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174892.413064:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174892.413170:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174892.924997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174893.437089:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174893.437172:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174893.949071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174894.461006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174894.461061:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174894.973017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174895.485054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174895.485208:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174895.997046:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.997060:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786174895.997063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174895.997066:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174895.997097:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8630
00000100:00080000:3.0:1786174895.997112:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.997122:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174895.997172:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145197312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174895.997210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.997215:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174895.997218:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174895.997223:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8630
00000100:00080000:3.0:1786174895.997228:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.997233:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174895.997246:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174895.997266:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145197312:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786174895.997267:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145197440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174895.997294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.997298:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174895.997301:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174895.997307:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8630
00000100:00080000:3.0:1786174895.997312:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.997317:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174895.997323:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174895.997338:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145197568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174895.997352:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.997358:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174895.997362:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174895.997370:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8630
00000100:00080000:3.0:1786174895.997378:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.997390:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786174895.997392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786174895.997408:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174895.997438:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145197696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174895.997461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.997466:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786174895.997473:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe64700 x1872931145197312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174895.997473:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174895.997491:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8630
00000100:00080000:3.0:1786174895.997504:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.997513:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174895.997521:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174895.997523:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145197312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174895.997546:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.997551:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.997556:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145197312:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786174895.997570:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145197824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174895.997591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145197440:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174895.997599:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.997610:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174895.997615:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174895.997627:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8630
00000800:00000100:1.0:1786174895.997635:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174895.997644:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.997657:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174895.997663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe65500 x1872931145197440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786174895.997670:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174895.997691:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145197440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174895.997704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145197952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174895.997709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.997722:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.997735:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145197440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174895.997754:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145197568:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174895.997761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.997772:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174895.997778:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786174895.997786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174895.997821:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8630
00000100:00080000:3.0:1786174895.997833:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.997840:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174895.997848:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe65880 x1872931145197568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786174895.997853:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174895.997878:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145197568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174895.997887:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145198080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174895.997937:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.997948:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.997960:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145197568:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174895.997966:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.997974:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786174895.997976:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145197696:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786174895.997979:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174895.997992:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8630
00000100:00080000:3.0:1786174895.997998:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.998004:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174895.998011:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174895.998020:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174895.998034:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145198208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174895.998048:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe66300 x1872931145197696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174895.998053:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174895.998067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174895.998083:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174895.998094:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8630
00000100:00100000:1.0:1786174895.998100:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145197696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174895.998103:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174895.998118:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174895.998133:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786174895.998134:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.998148:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.998160:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145197696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174895.998161:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145198336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174895.998199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145197824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174895.998226:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174895.998239:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe64000 x1872931145197824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174895.998253:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145197824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174895.998263:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.998266:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.998270:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145197824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174895.998277:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145197952:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174895.998296:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174895.998307:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe67100 x1872931145197952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174895.998322:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145197952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174895.998338:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.998343:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.998350:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145197952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174895.998361:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145198080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174895.998398:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174895.998421:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe67b80 x1872931145198080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174895.998445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145198080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174895.998456:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.998460:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.998465:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145198080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174895.998473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145198208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174895.998499:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174895.998513:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe65f80 x1872931145198208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174895.998527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145198208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174895.998545:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.998549:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.998553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145198208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174895.998560:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145198336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174895.998578:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174895.998588:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174895/real 1786174895]  req@ffff89d99fe67800 x1872931145198336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174895.998601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145198336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174895.998611:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174895.998614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174895.998618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145198336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174896.509010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174896.509142:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174897.021091:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174897.532996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174897.533062:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174898.044975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174898.557036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174898.557116:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174899.069139:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174899.581008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174899.581045:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174900.092981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174900.605031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174900.605146:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174901.117099:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174901.117125:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174901.117136:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174901.117141:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174901.117154:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00080000:0.0:1786174901.117179:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174901.117189:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174901.117247:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145198464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174901.117286:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174901.117292:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174901.117294:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174901.117299:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00080000:0.0:1786174901.117303:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174901.117309:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174901.117322:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174901.117339:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145198592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174901.117354:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145198464:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174901.117385:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174901.117389:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174901.117391:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174901.117398:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00080000:0.0:1786174901.117401:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174901.117407:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174901.117414:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174901.117434:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145198720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174901.117446:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174901.117451:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174901.117455:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174901.117459:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00080000:0.0:1786174901.117465:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786174901.117473:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174901.117480:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174901.117491:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174901.117508:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145198848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174901.117520:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174901.117525:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174901.117528:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174901.117534:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00080000:0.0:1786174901.117541:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174901.117551:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174901.117553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f1880 x1872931145198464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786174901.117558:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174901.117581:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145198976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174901.117598:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174901.117603:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174901.117606:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174901.117613:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145198464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174901.117617:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00080000:0.0:1786174901.117625:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174901.117637:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174901.117650:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786174901.117660:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786174901.117671:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145199104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174901.117673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174901.117688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145198464:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174901.117715:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174901.117723:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174901.117728:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174901.117732:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145198592:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174901.117791:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00080000:0.0:1786174901.117813:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174901.117821:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174901.117832:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786174901.117833:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174901.117867:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145199232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174901.117871:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f0700 x1872931145198592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174901.117945:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145198592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174901.117968:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174901.117983:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174901.117994:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174901.117995:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145198592:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174901.118013:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174901.118020:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174901.118021:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145198720:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174901.118038:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00080000:0.0:1786174901.118045:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174901.118056:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174901.118065:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174901.118080:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174901.118088:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145199360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174901.118102:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f1500 x1872931145198720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174901.118107:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174901.118124:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174901.118130:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174901.118145:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8635
00000100:00100000:1.0:1786174901.118152:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145198720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174901.118154:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174901.118171:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174901.118181:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174901.118195:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145199488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174901.118202:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174901.118221:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174901.118231:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145198720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174901.118248:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145198848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174901.118302:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174901.118320:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f3b80 x1872931145198848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174901.118336:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145198848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174901.118347:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174901.118351:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174901.118355:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145198848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174901.118363:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145198976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174901.118385:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174901.118398:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f2d80 x1872931145198976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174901.118412:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145198976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174901.118421:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174901.118425:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174901.118428:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145198976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174901.118435:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145199104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174901.118453:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174901.118465:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f3480 x1872931145199104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174901.118479:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145199104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174901.118489:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174901.118493:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174901.118498:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145199104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174901.118540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145199232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174901.118582:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174901.118605:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f2680 x1872931145199232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174901.118623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145199232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174901.118633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174901.118637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174901.118641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145199232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174901.118649:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145199360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174901.118677:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174901.118689:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f2a00 x1872931145199360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174901.118702:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145199360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174901.118722:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174901.118725:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174901.118729:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145199360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174901.118736:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145199488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174901.118790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174901.118814:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174901/real 1786174901]  req@ffff89d9870f0e00 x1872931145199488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174901.118829:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145199488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174901.118840:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174901.118843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174901.118847:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145199488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174901.628978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174901.629048:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174902.141040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174902.653069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174902.653116:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174903.165051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174903.677052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174903.677235:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174904.188999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174904.701047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174904.701156:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174905.213087:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174905.725036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174905.725110:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174906.237092:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174906.237094:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174906.237108:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174906.237113:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174906.237126:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8640
00000100:00080000:3.0:1786174906.237138:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174906.237151:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174906.237200:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145199616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174906.237269:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174906.237274:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174906.237277:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174906.237282:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8640
00000100:00080000:3.0:1786174906.237288:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174906.237295:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174906.237309:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174906.237332:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145199744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174906.237353:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145199616:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174906.237354:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174906.237365:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174906.237373:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174906.237382:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8640
00000100:00080000:3.0:1786174906.237390:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174906.237395:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174906.237403:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174906.237422:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145199872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174906.237435:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174906.237440:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174906.237442:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174906.237447:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8640
00000100:00080000:3.0:1786174906.237453:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174906.237457:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174906.237464:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786174906.237474:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174906.237487:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145200000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174906.237544:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe65180 x1872931145199616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174906.237583:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145199616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174906.237594:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174906.237608:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174906.237613:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174906.237617:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174906.237624:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8640
00000100:00080000:3.0:1786174906.237634:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174906.237635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174906.237648:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174906.237656:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145199616:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786174906.237660:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174906.237691:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145200128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174906.237752:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145199744:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174906.237758:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786174906.237820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174906.237848:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe64380 x1872931145199744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174906.237880:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145199744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174906.237972:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174906.237982:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174906.237987:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174906.237991:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174906.238002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145199744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174906.238020:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145199872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174906.238073:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174906.238105:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe66d80 x1872931145199872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174906.238138:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8640
00000100:00080000:3.0:1786174906.238157:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174906.238168:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174906.238179:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145199872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786174906.238180:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786174906.238210:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786174906.238215:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145200256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174906.238234:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174906.238249:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174906.238254:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145199872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174906.238257:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174906.238264:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174906.238279:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8640
00000100:00080000:3.0:1786174906.238286:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174906.238289:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145200000:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786174906.238296:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174906.238309:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174906.238329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145200384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174906.238342:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174906.238347:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174906.238349:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174906.238359:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8640
00000800:00000100:2.0:1786174906.238362:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174906.238367:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174906.238376:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174906.238383:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174906.238400:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe66680 x1872931145200000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174906.238404:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145200512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174906.238464:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174906.238471:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174906.238473:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174906.238481:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145200000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174906.238483:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8640
00000100:00080000:3.0:1786174906.238493:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174906.238505:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174906.238518:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786174906.238525:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786174906.238535:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145200640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174906.238538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174906.238556:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145200000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174906.238604:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145200128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174906.238642:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174906.238661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe67800 x1872931145200128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174906.238684:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145200128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174906.238742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174906.238749:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174906.238767:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145200128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174906.238779:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145200256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174906.238823:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174906.238855:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe65f80 x1872931145200256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174906.238880:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145200256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174906.238955:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174906.238965:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174906.238974:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145200256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174906.238989:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145200384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174906.239036:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174906.239068:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe67b80 x1872931145200384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174906.239095:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145200384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174906.239112:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174906.239119:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174906.239127:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145200384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174906.239140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145200512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174906.239171:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174906.239189:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe67100 x1872931145200512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174906.239212:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145200512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174906.239239:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174906.239245:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174906.239251:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145200512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174906.239262:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145200640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174906.239290:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174906.239306:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174906/real 1786174906]  req@ffff89d99fe64000 x1872931145200640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174906.239329:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145200640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174906.239346:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174906.239351:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174906.239357:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145200640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174906.749065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174906.749174:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174907.261131:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174907.773057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174907.773149:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174908.284997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174908.797057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174908.797103:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174909.308994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174909.821046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174909.821164:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174910.332983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174910.844993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174910.845168:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786174911.357041:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174911.357053:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174911.357059:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174911.357062:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174911.357072:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00080000:3.0:1786174911.357085:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174911.357094:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174911.357142:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145200768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174911.357186:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174911.357191:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174911.357193:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174911.357197:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00080000:3.0:1786174911.357201:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174911.357205:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174911.357216:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174911.357229:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145200896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174911.357248:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174911.357251:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174911.357253:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174911.357257:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00080000:3.0:1786174911.357260:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174911.357264:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174911.357268:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174911.357279:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145201024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174911.357291:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174911.357295:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174911.357297:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174911.357305:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00100000:2.0:1786174911.357307:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145200768:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174911.357309:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174911.357319:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174911.357326:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174911.357340:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145201152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174911.357351:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174911.357355:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174911.357358:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174911.357361:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00080000:3.0:1786174911.357376:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174911.357381:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174911.357385:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174911.357396:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145201280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174911.357408:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786174911.357409:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174911.357415:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174911.357419:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174911.357425:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00080000:3.0:1786174911.357429:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174911.357434:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174911.357440:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174911.357453:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145201408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174911.357464:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174911.357469:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe66300 x1872931145200768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174911.357470:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174911.357476:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174911.357489:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00080000:3.0:1786174911.357497:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174911.357503:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174911.357509:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174911.357516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145200768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174911.357527:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145201536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174911.357536:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174911.357542:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174911.357548:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786174911.357550:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174911.357555:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786174911.357560:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145200768:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174911.357565:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00080000:3.0:1786174911.357576:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174911.357584:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145200896:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786174911.357585:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174911.357597:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174911.357613:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145201664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174911.357624:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786174911.357628:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786174911.357631:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174911.357635:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174911.357643:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8645
00000100:00080000:3.0:1786174911.357673:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786174911.357676:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe65880 x1872931145200896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174911.357682:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174911.357693:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174911.357705:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145200896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174911.357724:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145201792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174911.357738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174911.357748:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174911.357754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145200896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174911.357763:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145201024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174911.357787:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174911.357799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe65500 x1872931145201024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174911.357812:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145201024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174911.357838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174911.357841:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174911.357845:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145201024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174911.357871:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145201152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174911.357891:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174911.357942:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe64700 x1872931145201152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174911.357956:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145201152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174911.357984:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174911.357987:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174911.357992:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145201152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174911.358000:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145201280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174911.358026:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174911.358055:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe64a80 x1872931145201280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174911.358068:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145201280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174911.358076:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174911.358079:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174911.358083:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145201280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174911.358089:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145201408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174911.358105:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174911.358114:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe66a00 x1872931145201408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174911.358126:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145201408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174911.358133:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174911.358136:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174911.358140:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145201408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174911.358145:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145201536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174911.358160:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174911.358169:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe67480 x1872931145201536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174911.358181:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145201536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174911.358189:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174911.358192:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174911.358195:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145201536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174911.358201:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145201664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174911.358216:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174911.358232:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe64000 x1872931145201664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174911.358244:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145201664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174911.358252:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174911.358255:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174911.358258:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145201664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174911.358263:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145201792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174911.358280:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174911.358289:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174911/real 1786174911]  req@ffff89d99fe67100 x1872931145201792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174911.358301:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145201792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174911.358309:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174911.358312:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174911.358315:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145201792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174911.869010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174911.869129:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174912.381017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174912.892973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174912.893048:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174913.405031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174913.917006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174913.917133:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174914.429007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174914.941005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174914.941120:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174915.453052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174915.964980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174915.965032:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174916.476994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786174916.476994:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174916.477003:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786174916.477007:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477016:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00080000:3.0:1786174916.477025:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477032:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174916.477064:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145201920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174916.477086:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174916.477088:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174916.477090:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477093:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00080000:3.0:1786174916.477095:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477098:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174916.477105:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174916.477114:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145202048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174916.477122:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786174916.477124:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145201920:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174916.477125:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174916.477128:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477136:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00080000:3.0:1786174916.477139:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477141:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174916.477144:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174916.477154:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145202176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174916.477161:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174916.477163:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174916.477164:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477166:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00080000:3.0:1786174916.477178:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477180:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174916.477184:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786174916.477193:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174916.477194:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145202304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174916.477203:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174916.477205:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174916.477207:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477210:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00080000:3.0:1786174916.477212:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477215:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174916.477218:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174916.477225:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145202432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174916.477231:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174916.477233:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174916.477234:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477236:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00080000:3.0:1786174916.477238:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477240:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174916.477243:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174916.477249:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe67b80 x1872931145201920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174916.477253:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145202560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174916.477284:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174916.477287:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786174916.477288:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477294:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00100000:2.0:1786174916.477295:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145201920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174916.477297:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477303:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174916.477309:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786174916.477314:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786174916.477319:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145202688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174916.477320:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477327:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145201920:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786174916.477335:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174916.477338:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174916.477340:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477343:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00080000:3.0:1786174916.477345:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477347:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786174916.477351:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786174916.477356:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145202048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174916.477360:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145202816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174916.477369:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174916.477371:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174916.477373:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174916.477376:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8650
00000100:00080000:3.0:1786174916.477379:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174916.477383:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786174916.477387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786174916.477389:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174916.477399:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145202944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786174916.477402:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe65f80 x1872931145202048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174916.477425:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145202048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174916.477433:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174916.477435:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477438:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145202048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174916.477444:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145202176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174916.477457:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174916.477463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe67800 x1872931145202176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174916.477471:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145202176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174916.477480:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174916.477482:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477484:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145202176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174916.477488:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145202304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174916.477498:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174916.477503:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe66680 x1872931145202304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174916.477510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145202304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174916.477515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174916.477517:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477519:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145202304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174916.477522:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145202432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174916.477531:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174916.477537:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe66d80 x1872931145202432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174916.477544:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145202432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174916.477548:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174916.477550:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145202432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174916.477556:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145202560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174916.477567:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174916.477572:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe64380 x1872931145202560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174916.477579:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145202560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174916.477585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174916.477586:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477588:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145202560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174916.477591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145202688:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786174916.477619:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174916.477627:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe65180 x1872931145202688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174916.477635:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145202688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174916.477640:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174916.477642:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477644:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145202688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174916.477658:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145202816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174916.477673:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174916.477684:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe67b80 x1872931145202816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174916.477696:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145202816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174916.477705:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174916.477708:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145202816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174916.477718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145202944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786174916.477734:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786174916.477742:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174916/real 1786174916]  req@ffff89d99fe67100 x1872931145202944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174916.477749:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145202944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174916.477755:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174916.477757:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786174916.477759:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145202944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174916.989016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174916.989147:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174917.500992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786174918.012988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174918.013068:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174918.525049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174919.037054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174919.037123:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174919.549046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174920.061026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174920.061147:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174920.573039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174921.085027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174921.085141:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174921.597048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174921.597082:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174921.597089:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174921.597093:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174921.597102:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00080000:0.0:1786174921.597111:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174921.597118:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174921.597154:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145203072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174921.597200:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174921.597205:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174921.597207:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174921.597211:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00080000:0.0:1786174921.597214:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174921.597218:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174921.597227:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174921.597239:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145203200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174921.597251:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174921.597255:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174921.597260:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174921.597260:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145203072:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174921.597269:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00080000:0.0:1786174921.597273:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174921.597276:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174921.597280:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174921.597293:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145203328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174921.597300:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174921.597303:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174921.597305:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174921.597308:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00080000:0.0:1786174921.597310:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174921.597313:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174921.597317:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174921.597326:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145203456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174921.597334:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174921.597336:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174921.597338:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786174921.597345:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174921.597348:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00080000:0.0:1786174921.597354:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174921.597357:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174921.597362:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174921.597372:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145203584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174921.597381:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174921.597384:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174921.597386:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174921.597391:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00100000:1.0:1786174921.597392:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f1180 x1872931145203072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174921.597394:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174921.597401:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174921.597409:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174921.597424:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145203712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174921.597432:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174921.597434:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145203072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174921.597436:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174921.597440:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174921.597449:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00080000:0.0:1786174921.597455:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174921.597460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174921.597466:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174921.597468:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174921.597471:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145203072:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786174921.597480:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174921.597497:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145203840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174921.597501:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145203200:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174921.597522:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174921.597527:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786174921.597532:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174921.597533:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174921.597542:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00080000:0.0:1786174921.597565:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174921.597569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f0a80 x1872931145203200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174921.597573:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174921.597583:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174921.597593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145203200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174921.597600:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145203968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174921.597608:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174921.597616:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174921.597617:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174921.597626:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786174921.597627:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145203200:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174921.597632:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174921.597642:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8655
00000100:00080000:0.0:1786174921.597645:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174921.597647:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145203328:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174921.597652:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174921.597659:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174921.597681:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174921.597682:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145204096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174921.597694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f3100 x1872931145203328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174921.597707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145203328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174921.597715:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174921.597718:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174921.597721:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145203328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174921.597725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145203456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174921.597738:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174921.597745:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f0e00 x1872931145203456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174921.597754:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145203456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174921.597761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174921.597763:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174921.597765:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145203456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174921.597770:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145203584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174921.597781:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174921.597788:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f2a00 x1872931145203584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174921.597797:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145203584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174921.597803:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174921.597805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174921.597808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145203584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174921.597812:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145203712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174921.597824:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174921.597831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f2680 x1872931145203712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174921.597840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145203712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174921.597846:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174921.597848:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174921.597850:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145203712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174921.597866:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145203840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174921.597878:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174921.597886:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f3480 x1872931145203840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174921.597894:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145203840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174921.597928:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174921.597931:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174921.597934:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145203840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174921.597946:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145203968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174921.597962:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174921.597976:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f2d80 x1872931145203968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174921.597992:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145203968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174921.598003:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174921.598007:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174921.598011:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145203968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174921.598020:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145204096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174921.598043:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174921.598054:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174921/real 1786174921]  req@ffff89d9870f3b80 x1872931145204096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174921.598064:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145204096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174921.598081:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174921.598084:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174921.598087:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145204096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174922.109059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174922.109100:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174922.621085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174923.133147:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174923.133169:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174923.645033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174924.157018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174924.157162:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174924.668982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174925.181024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174925.181055:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174925.693032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174926.205017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174926.205122:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786174926.717040:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.717057:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786174926.717065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174926.717067:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174926.717107:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00080000:0.0:1786174926.717121:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174926.717132:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174926.717198:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145204224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174926.717238:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.717246:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174926.717249:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174926.717255:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00080000:0.0:1786174926.717263:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174926.717270:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174926.717285:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174926.717288:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145204224:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786174926.717315:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145204352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174926.717337:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.717343:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174926.717346:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174926.717353:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00080000:0.0:1786174926.717362:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174926.717368:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174926.717375:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174926.717394:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145204480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174926.717411:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.717417:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174926.717419:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174926.717425:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00080000:0.0:1786174926.717432:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174926.717438:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174926.717448:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174926.717471:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145204608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174926.717479:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145204352:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174926.717530:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.717539:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174926.717543:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174926.717551:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00100000:1.0:1786174926.717558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145204480:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174926.717562:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174926.717574:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174926.717584:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174926.717598:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145204608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174926.717611:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145204736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174926.717649:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.717655:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174926.717659:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174926.717667:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00080000:0.0:1786174926.717675:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174926.717677:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145204736:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786174926.717688:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174926.717699:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174926.717723:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145204864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174926.717749:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.717756:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174926.717761:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174926.717770:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145204864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174926.717772:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00080000:0.0:1786174926.717784:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174926.717792:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174926.717802:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174926.717824:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145204992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174926.717851:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.717856:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174926.717859:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174926.717865:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00080000:0.0:1786174926.717872:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174926.717880:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174926.717889:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174926.717889:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145204992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174926.717987:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145205120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174926.718020:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174926.718026:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174926.718029:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174926.718035:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8660
00000100:00080000:0.0:1786174926.718042:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174926.718048:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174926.718056:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174926.718078:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145205248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174926.718123:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145205120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174926.718192:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145205248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174927.229032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174927.229130:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174927.741053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174928.253017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174928.253138:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174928.765092:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174929.277136:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174929.277231:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174929.789035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:3.0:1786174929.789296:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:3.0:1786174929.789349:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1786174929.789370:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174929.789436:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:3.0:1786174929.789460:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174929.789514:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786174929.789527:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f0e00 x1872931145205248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786174929.789543:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174929.789568:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786174929.789594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145205248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786174929.789599:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786174929.789626:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786174929.789634:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:3.0:1786174929.789647:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786174929.789654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.789669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145205248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174929.789687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f2a00 x1872931145205120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174929.789717:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145205120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174929.789734:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174929.789741:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.789748:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145205120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174929.789761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f2680 x1872931145204992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174929.789784:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145204992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174929.789797:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174929.789803:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.789809:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145204992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174929.789821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f3480 x1872931145204864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174929.789842:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145204864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174929.789858:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174929.789864:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.789871:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145204864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174929.789884:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f2d80 x1872931145204736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174929.789977:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145204736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174929.790002:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174929.790009:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.790017:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145204736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174929.790030:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f3b80 x1872931145204608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174929.790051:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145204608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174929.790095:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174929.790105:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.790114:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145204608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174929.790130:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f0700 x1872931145204352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174929.790157:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145204352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174929.790174:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174929.790182:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.790189:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145204352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174929.790201:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f1880 x1872931145204480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174929.790226:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145204480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174929.790242:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174929.790248:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.790255:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145204480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174929.790268:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174926/real 1786174929]  req@ffff89d9870f1500 x1872931145204224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174929.790291:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145204224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174929.790304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174929.790310:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174929.790317:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145204224:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786174930.300980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174930.301089:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174930.813000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174931.325050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174931.325137:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174931.837068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174931.837168:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.837177:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174931.837182:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174931.837193:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:0.0:1786174931.837204:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174931.837213:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174931.837266:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145205376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174931.837298:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.837303:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174931.837305:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174931.837309:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:0.0:1786174931.837313:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174931.837317:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174931.837328:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174931.837345:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145205504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174931.837358:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145205376:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174931.837363:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.837372:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174931.837374:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174931.837380:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:0.0:1786174931.837384:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174931.837390:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174931.837395:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174931.837411:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145205632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174931.837422:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.837426:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174931.837428:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174931.837432:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:0.0:1786174931.837437:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174931.837441:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174931.837468:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174931.837492:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174931.837503:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145205760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174931.837515:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.837519:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174931.837522:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174931.837526:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:0.0:1786174931.837532:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174931.837537:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174931.837562:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174931.837564:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f3100 x1872931145205376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174931.837589:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145205888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174931.837622:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145205376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174931.837630:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.837643:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174931.837650:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174931.837653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174931.837661:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:1.0:1786174931.837667:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174931.837689:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174931.837698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145205376:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174931.837707:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174931.837720:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174931.837743:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145206016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174931.837747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145205504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174931.837779:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.837786:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174931.837791:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174931.837800:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:0.0:1786174931.837809:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786174931.837813:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174931.837822:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174931.837834:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174931.837849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f0a80 x1872931145205504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174931.837863:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145206144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174931.837887:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145205504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174931.837891:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.837907:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174931.837915:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174931.837922:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174931.837930:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:1.0:1786174931.837938:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174931.837943:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174931.837951:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145205504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174931.838011:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145205632:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174931.838031:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174931.838047:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786174931.838059:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174931.838080:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145206272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174931.838093:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f1180 x1872931145205632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174931.838115:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174931.838124:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786174931.838132:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145205632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174931.838133:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174931.838152:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8666
00000100:00080000:0.0:1786174931.838165:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174931.838184:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174931.838193:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786174931.838199:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786174931.838209:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174931.838212:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145205632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174931.838231:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145205760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174931.838243:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145206400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786174931.838280:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174931.838311:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f1500 x1872931145205760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174931.838335:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145205760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174931.838351:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174931.838358:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174931.838363:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145205760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174931.838377:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145205888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174931.838414:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174931.838435:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f1880 x1872931145205888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174931.838486:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145205888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174931.838504:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174931.838511:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174931.838518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145205888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174931.838565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145206016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174931.838604:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174931.838626:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f0700 x1872931145206016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174931.838650:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145206016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174931.838664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174931.838670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174931.838676:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145206016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174931.838688:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145206144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174931.838723:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174931.838742:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f3b80 x1872931145206144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174931.838757:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145206144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174931.838766:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174931.838770:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174931.838773:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145206144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174931.838781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145206272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174931.838801:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174931.838812:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f2d80 x1872931145206272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174931.838825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145206272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174931.838836:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174931.838841:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174931.838848:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145206272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174931.838859:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145206400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174931.838892:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174931.838951:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174931/real 1786174931]  req@ffff89d9870f3480 x1872931145206400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174931.838975:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145206400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174931.838991:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174931.838997:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174931.839002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145206400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174932.349026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174932.349247:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174932.860989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174933.373010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174933.373099:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786174933.885096:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174934.396983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174934.397072:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174934.909085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174935.421034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174935.421092:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174935.933048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174936.445051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174936.445124:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174936.957033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174936.957071:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957085:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174936.957093:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174936.957109:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8671
00000100:00080000:0.0:1786174936.957129:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174936.957142:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174936.957205:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145206528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174936.957245:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957251:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174936.957254:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174936.957259:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8671
00000100:00080000:0.0:1786174936.957265:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174936.957272:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174936.957288:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174936.957307:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145206656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174936.957310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145206528:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174936.957350:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957355:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174936.957357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174936.957363:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8671
00000100:00080000:0.0:1786174936.957371:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174936.957376:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174936.957382:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174936.957426:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145206784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174936.957440:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957444:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174936.957447:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174936.957460:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8671
00000800:00000100:1.0:1786174936.957463:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174936.957468:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174936.957477:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174936.957488:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174936.957510:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145206912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174936.957531:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957538:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786174936.957539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f2680 x1872931145206528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174936.957541:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174936.957553:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8671
00000100:00080000:0.0:1786174936.957563:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174936.957577:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174936.957588:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174936.957603:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145207040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174936.957618:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145206528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174936.957622:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957640:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174936.957649:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174936.957666:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8671
00000100:00080000:1.0:1786174936.957671:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174936.957672:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174936.957690:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786174936.957691:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786174936.957713:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174936.957713:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145206528:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786174936.957743:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145207168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174936.957755:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957759:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174936.957761:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174936.957766:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8671
00000100:00080000:0.0:1786174936.957771:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174936.957776:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145206656:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174936.957780:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174936.957791:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174936.957807:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145207296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174936.957824:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957829:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174936.957831:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786174936.957840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174936.957844:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8671
00000100:00080000:0.0:1786174936.957852:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174936.957860:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174936.957867:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174936.957869:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f2a00 x1872931145206656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174936.957888:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145207424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174936.957940:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145206656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174936.957944:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174936.957973:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174936.957986:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174936.957992:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174936.957996:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8671
00000100:00080000:0.0:1786174936.958007:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174936.958011:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174936.958018:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174936.958027:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174936.958032:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145206656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174936.958045:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145207552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174936.958057:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145206784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174936.958123:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174936.958140:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f0e00 x1872931145206784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174936.958168:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145206784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174936.958181:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174936.958186:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174936.958192:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145206784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174936.958202:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145206912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174936.958233:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174936.958245:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f3480 x1872931145206912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174936.958256:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145206912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174936.958264:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174936.958267:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174936.958270:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145206912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174936.958276:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145207040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174936.958301:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174936.958317:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f2d80 x1872931145207040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174936.958335:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145207040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174936.958357:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174936.958360:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174936.958363:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145207040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174936.958370:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145207168:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174936.958392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174936.958430:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f3b80 x1872931145207168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174936.958443:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145207168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174936.958450:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174936.958453:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174936.958456:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145207168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174936.958480:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145207296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174936.958508:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174936.958525:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f0700 x1872931145207296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174936.958544:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145207296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174936.958556:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174936.958561:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174936.958567:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145207296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174936.958577:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145207424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174936.958609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174936.958627:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f1880 x1872931145207424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174936.958646:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145207424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174936.958655:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174936.958658:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174936.958661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145207424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174936.958667:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145207552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174936.958689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174936.958699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174936/real 1786174936]  req@ffff89d9870f1500 x1872931145207552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174936.958709:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145207552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174936.958716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174936.958719:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174936.958721:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145207552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174937.469034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174937.469128:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174937.981041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174938.493015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174938.493084:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174939.005023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174939.517115:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174939.517149:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174940.029089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174940.541018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174940.541251:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786174941.052990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174941.564978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174941.565074:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786174942.077081:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174942.077095:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174942.077102:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174942.077104:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174942.077116:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077133:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077144:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174942.077194:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145207680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174942.077235:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174942.077241:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174942.077243:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174942.077248:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077254:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077260:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174942.077274:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174942.077296:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145207808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174942.077314:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145207680:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174942.077317:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174942.077332:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174942.077337:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174942.077346:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077385:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077393:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174942.077411:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174942.077434:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145207936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174942.077459:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174942.077464:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174942.077467:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786174942.077476:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174942.077482:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077492:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077501:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174942.077511:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174942.077533:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145208064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174942.077548:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174942.077554:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f1180 x1872931145207680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174942.077555:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174942.077563:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174942.077579:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077588:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077595:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174942.077604:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174942.077606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145207680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174942.077627:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145208192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174942.077629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174942.077645:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174942.077650:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174942.077653:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174942.077658:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077662:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077667:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174942.077673:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174942.077687:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145208320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174942.077699:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174942.077703:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174942.077706:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174942.077712:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077718:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077724:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174942.077729:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786174942.077742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786174942.077744:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145208448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174942.077758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145207680:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174942.077770:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174942.077775:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174942.077778:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174942.077786:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077790:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077795:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174942.077801:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174942.077802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145207808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174942.077825:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145208576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174942.077842:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174942.077846:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174942.077848:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786174942.077858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174942.077859:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8676
00000100:00080000:0.0:1786174942.077870:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174942.077874:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174942.077880:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174942.077892:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145208704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174942.078127:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f0a80 x1872931145207808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174942.078151:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145207808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174942.078165:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174942.078172:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174942.078178:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145207808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174942.078187:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145207936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174942.078291:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174942.078309:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f3100 x1872931145207936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174942.078325:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145207936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174942.078336:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174942.078340:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174942.078344:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145207936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174942.078379:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145208064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174942.078412:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174942.078427:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f1500 x1872931145208064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174942.078442:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145208064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174942.078453:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174942.078457:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174942.078461:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145208064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174942.078468:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145208192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174942.078487:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174942.078498:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f1880 x1872931145208192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174942.078512:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145208192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174942.078523:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174942.078526:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174942.078530:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145208192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174942.078536:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145208320:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174942.078554:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174942.078565:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f0700 x1872931145208320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174942.078578:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145208320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174942.078587:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174942.078590:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174942.078594:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145208320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174942.078600:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145208448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174942.078618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174942.078629:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f3b80 x1872931145208448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174942.078643:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145208448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174942.078652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174942.078655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174942.078660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145208448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174942.078685:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145208576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174942.078705:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174942.078717:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f2d80 x1872931145208576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174942.078731:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145208576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174942.078741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174942.078745:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174942.078748:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145208576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174942.078754:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145208704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174942.078773:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174942.078783:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174942/real 1786174942]  req@ffff89d9870f3480 x1872931145208704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174942.078798:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145208704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174967 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174942.078807:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174942.078810:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174942.078814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145208704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174942.589039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174942.589153:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174943.101037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174943.612976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174943.613025:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174944.124983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174944.637080:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174944.637176:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174945.149049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174945.661029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174945.661156:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174946.173011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174946.685038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174946.685144:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174947.196995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174947.197003:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174947.197010:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174947.197015:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174947.197025:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:0.0:1786174947.197038:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174947.197046:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174947.197085:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145208832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174947.197129:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174947.197133:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174947.197135:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174947.197138:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:0.0:1786174947.197142:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174947.197147:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174947.197156:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174947.197186:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145208960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174947.197196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145208832:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174947.197209:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174947.197214:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174947.197217:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174947.197224:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:0.0:1786174947.197230:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174947.197236:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174947.197244:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174947.197277:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145209088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174947.197288:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174947.197293:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174947.197297:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174947.197333:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174947.197355:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:0.0:1786174947.197360:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174947.197365:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174947.197372:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174947.197387:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f0e00 x1872931145208832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174947.197392:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145209216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174947.197416:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145208832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174947.197417:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174947.197430:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174947.197437:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174947.197438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174947.197445:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:3.0:1786174947.197446:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174947.197455:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174947.197456:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145208832:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174947.197464:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174947.197470:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174947.197482:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145209344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174947.197486:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145208960:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174947.197503:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174947.197507:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174947.197509:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174947.197513:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:0.0:1786174947.197518:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786174947.197522:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174947.197526:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174947.197532:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174947.197540:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f2a00 x1872931145208960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174947.197561:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145209472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174947.197580:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174947.197582:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145208960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174947.197584:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174947.197588:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174947.197598:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:3.0:1786174947.197601:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174947.197603:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174947.197610:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174947.197611:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174947.197618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145208960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174947.197626:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145209088:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786174947.197631:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174947.197651:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145209600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174947.197653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174947.197665:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f2680 x1872931145209088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174947.197670:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174947.197680:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1786174947.197681:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145209088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174947.197685:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174947.197697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174947.197699:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:3.0:1786174947.197704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174947.197709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145209088:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174947.197711:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174947.197717:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145209216:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786174947.197722:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786174947.197738:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786174947.197739:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174947.197749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f3480 x1872931145209216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174947.197758:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145209728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174947.197765:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145209216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174947.197773:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174947.197781:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174947.197782:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174947.197787:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174947.197790:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174947.197795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145209216:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786174947.197801:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8681
00000100:00080000:0.0:1786174947.197806:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174947.197810:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174947.197815:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145209344:192.168.202.130@tcp:8:kworker.0
00000008:00100000:0.0:1786174947.197818:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174947.197851:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145209856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174947.197860:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174947.197880:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f2d80 x1872931145209344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174947.197892:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145209344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174947.197899:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174947.197919:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174947.197921:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145209344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174947.197926:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145209472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174947.197941:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174947.197975:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f3b80 x1872931145209472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174947.197985:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145209472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174947.197993:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174947.197995:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174947.197998:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145209472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174947.198003:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145209600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174947.198018:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174947.198026:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f0700 x1872931145209600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174947.198035:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145209600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174947.198042:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174947.198045:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174947.198047:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145209600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174947.198052:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145209728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174947.198064:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174947.198071:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f1880 x1872931145209728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174947.198099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145209728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174947.198110:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174947.198114:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174947.198118:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145209728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174947.198138:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145209856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174947.198165:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174947.198178:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174947/real 1786174947]  req@ffff89d9870f1500 x1872931145209856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174947.198188:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145209856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174947.198195:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174947.198197:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174947.198200:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145209856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174947.709024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174947.709150:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174948.221007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174948.733045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174948.733150:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174949.245087:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174949.757053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174949.757225:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174950.268999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174950.781079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174950.781334:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174951.292997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174951.805064:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174951.805205:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174952.317006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786174952.317140:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.317156:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786174952.317164:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174952.317181:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:2.0:1786174952.317199:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174952.317212:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786174952.317306:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145209984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174952.317350:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.317356:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174952.317359:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174952.317364:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:2.0:1786174952.317370:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174952.317376:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174952.317391:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174952.317415:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145210112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174952.317419:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145209984:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174952.317473:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.317478:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174952.317482:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174952.317492:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:2.0:1786174952.317499:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174952.317503:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174952.317511:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174952.317528:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145210240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174952.317544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174952.317558:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.317569:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174952.317573:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174952.317585:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:2.0:1786174952.317596:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174952.317605:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87dc00 x1872931145209984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174952.317611:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174952.317647:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174952.317658:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145209984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174952.317678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786174952.317687:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145210368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174952.317693:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174952.317720:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145209984:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786174952.317741:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.317747:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174952.317750:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174952.317757:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:2.0:1786174952.317764:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786174952.317772:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174952.317781:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174952.317798:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145210112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174952.317801:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145210496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786174952.317850:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.317859:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786174952.317864:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174952.317875:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:2.0:1786174952.317884:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786174952.317890:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174952.317963:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174952.317974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87c000 x1872931145210112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786174952.317975:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786174952.318019:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145210624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174952.318033:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145210112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174952.318043:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.318065:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786174952.318075:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174952.318093:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:2.0:1786174952.318105:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174952.318107:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174952.318116:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786174952.318126:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786174952.318133:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174952.318144:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145210112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786174952.318161:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145210752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174952.318167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145210240:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786174952.318216:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.318221:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786174952.318225:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786174952.318235:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:2.0:1786174952.318244:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786174952.318244:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786174952.318285:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174952.318297:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174952.318307:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87ed80 x1872931145210240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786174952.318324:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145210880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174952.318347:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145210240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786174952.318351:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786174952.318385:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786174952.318396:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174952.318401:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786174952.318411:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8686
00000100:00080000:3.0:1786174952.318421:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786174952.318425:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174952.318434:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145210240:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786174952.318437:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786174952.318464:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174952.318473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145210368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786174952.318488:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145211008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174952.318515:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174952.318534:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87f800 x1872931145210368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174952.318552:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145210368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174952.318562:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174952.318567:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174952.318572:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145210368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174952.318600:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145210496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174952.318623:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174952.318635:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87df80 x1872931145210496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174952.318650:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145210496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174952.318660:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174952.318664:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174952.318667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145210496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174952.318675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145210624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174952.318694:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174952.318706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87ca80 x1872931145210624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174952.318720:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145210624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174952.318729:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174952.318733:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174952.318737:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145210624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174952.318744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145210752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174952.318767:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174952.318788:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87c700 x1872931145210752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174952.318812:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145210752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174952.318829:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174952.318835:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174952.318842:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145210752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174952.318855:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145210880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174952.318895:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174952.318962:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87c380 x1872931145210880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174952.318980:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145210880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174952.318991:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174952.318996:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174952.319002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145210880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174952.319015:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145211008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174952.319057:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174952.319080:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174952/real 1786174952]  req@ffff89d99e87e680 x1872931145211008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174952.319104:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145211008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174952.319118:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174952.319122:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174952.319126:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145211008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174952.829011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174952.829163:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174953.341040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174953.852982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174953.853129:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174954.364976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174954.877087:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174954.877208:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174955.389031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174955.901067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174955.901259:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174956.412955:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174956.925045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174956.925177:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174957.437015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786174957.437161:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174957.437173:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786174957.437180:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174957.437196:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00080000:1.0:1786174957.437234:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174957.437248:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174957.437303:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145211136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174957.437361:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174957.437368:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174957.437372:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174957.437380:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00080000:1.0:1786174957.437389:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174957.437399:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174957.437414:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174957.437416:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145211136:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786174957.437478:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145211264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174957.437503:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174957.437511:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174957.437516:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174957.437525:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00080000:1.0:1786174957.437534:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786174957.437537:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786174957.437552:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174957.437566:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174957.437596:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145211392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174957.437600:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2fce00 x1872931145211136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.437670:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174957.437672:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145211136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.437689:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174957.437700:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174957.437702:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174957.437722:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00080000:1.0:1786174957.437733:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174957.437736:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174957.437746:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174957.437752:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145211136:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786174957.437765:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174957.437791:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145211264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174957.437799:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145211520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174957.437828:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786174957.437834:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174957.437855:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2fe680 x1872931145211264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.437859:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174957.437869:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174957.437890:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145211264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.437892:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00080000:3.0:1786174957.437954:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174957.437960:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174957.437965:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145211264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174957.437984:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145211392:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174957.437988:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174957.438001:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174957.438014:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786174957.438023:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174957.438049:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2ff800 x1872931145211392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174957.438051:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145211648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174957.438093:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145211392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.438102:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174957.438111:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174957.438115:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174957.438121:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174957.438126:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174957.438129:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145211392:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174957.438146:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00080000:1.0:1786174957.438156:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174957.438163:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145211520:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786174957.438170:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174957.438185:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786174957.438197:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174957.438259:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145211776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174957.438286:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2fdc00 x1872931145211520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174957.438345:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145211520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.438349:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174957.438370:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174957.438378:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174957.438385:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174957.438393:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00080000:3.0:1786174957.438399:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174957.438410:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174957.438411:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145211520:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786174957.438429:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174957.438431:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145211648:192.168.202.130@tcp:8:kworker.0
00000008:00100000:1.0:1786174957.438460:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786174957.438506:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174957.438520:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145211904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174957.438531:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2fed80 x1872931145211648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.438575:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174957.438577:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145211648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.438597:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174957.438604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174957.438606:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174957.438616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174957.438626:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00100000:3.0:1786174957.438627:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145211648:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786174957.438647:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174957.438662:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174957.438666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145211776:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786174957.438680:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786174957.438709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174957.438732:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145212032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174957.438732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2fc700 x1872931145211776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174957.438790:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145211776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174957.438797:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174957.438810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174957.438811:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174957.438820:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174957.438825:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174957.438838:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8691
00000100:00100000:3.0:1786174957.438839:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145211776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174957.438859:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145211904:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174957.438861:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174957.438877:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786174957.438889:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786174957.438890:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174957.438926:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2fd880 x1872931145211904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174957.438944:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145212160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174957.438977:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145211904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174957.438990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174957.439000:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174957.439012:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145211904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174957.439041:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145212032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174957.439072:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174957.439086:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2ff480 x1872931145212032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174957.439099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145212032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174957.439109:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174957.439113:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174957.439116:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145212032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174957.439123:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145212160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174957.439140:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174957.439150:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174957/real 1786174957]  req@ffff89d9ba2fed80 x1872931145212160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174957.439163:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145212160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174957.439172:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174957.439175:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174957.439178:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145212160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174957.949046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174957.949234:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174958.461054:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174958.973110:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174958.973179:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174959.485040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174959.996987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174959.997030:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174960.508986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174961.020998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174961.021051:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174961.533018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174962.044996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174962.045052:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174962.557098:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174962.557218:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557241:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174962.557248:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174962.557261:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8696
00000100:00080000:0.0:1786174962.557274:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174962.557283:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174962.557341:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145212288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174962.557387:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557391:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174962.557393:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174962.557396:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8696
00000100:00080000:0.0:1786174962.557400:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174962.557404:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174962.557414:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174962.557428:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145212288:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786174962.557430:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145212416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174962.557446:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557449:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174962.557450:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174962.557467:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8696
00000100:00080000:0.0:1786174962.557470:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174962.557474:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174962.557479:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174962.557503:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145212544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174962.557510:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174962.557551:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557555:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174962.557557:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174962.557561:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8696
00000100:00080000:0.0:1786174962.557565:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174962.557568:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174962.557573:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174962.557587:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145212672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174962.557593:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f3100 x1872931145212288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174962.557615:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557624:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174962.557628:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174962.557636:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8696
00000100:00080000:0.0:1786174962.557640:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174962.557644:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174962.557648:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174962.557655:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145212288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174962.557661:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145212800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174962.557716:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557720:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786174962.557721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174962.557722:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174962.557731:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174962.557732:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8696
00000100:00080000:0.0:1786174962.557740:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174962.557742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145212288:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174962.557748:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174962.557754:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174962.557780:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145212928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174962.557788:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557791:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174962.557792:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174962.557795:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8696
00000100:00080000:0.0:1786174962.557798:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174962.557801:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174962.557805:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174962.557816:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145212416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174962.557817:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145213056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174962.557835:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557839:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174962.557840:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174962.557857:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8696
00000800:00000100:3.0:1786174962.557864:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174962.557881:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174962.557890:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174962.557895:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174962.557903:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f0a80 x1872931145212416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174962.557958:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145213184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174962.557981:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145212416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174962.557989:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174962.557997:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786174962.557998:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174962.557999:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174962.558008:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174962.558011:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8696
00000100:00100000:3.0:1786174962.558017:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145212416:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174962.558019:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174962.558029:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174962.558034:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145212544:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786174962.558039:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174962.558080:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145213312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174962.558097:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174962.558137:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f1180 x1872931145212544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174962.558178:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145212544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174962.558187:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174962.558190:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174962.558193:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145212544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174962.558199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145212672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174962.558229:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174962.558240:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f1500 x1872931145212672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174962.558251:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145212672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174962.558257:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174962.558260:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174962.558263:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145212672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174962.558267:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145212800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174962.558290:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174962.558297:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f1880 x1872931145212800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174962.558307:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145212800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174962.558313:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174962.558316:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174962.558318:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145212800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174962.558322:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145212928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174962.558335:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174962.558351:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f0700 x1872931145212928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174962.558360:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145212928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174962.558367:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174962.558370:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174962.558373:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145212928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174962.558389:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145213056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174962.558420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174962.558430:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f3b80 x1872931145213056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174962.558441:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145213056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174962.558449:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174962.558451:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174962.558454:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145213056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174962.558459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145213184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174962.558473:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174962.558482:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f2d80 x1872931145213184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174962.558493:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145213184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174962.558500:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174962.558503:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174962.558506:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145213184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174962.558511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145213312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174962.558524:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174962.558532:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174962/real 1786174962]  req@ffff89d9870f3480 x1872931145213312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174962.558542:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145213312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174962.558549:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174962.558552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174962.558554:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145213312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174963.069033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174963.069087:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174963.581000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174964.092986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174964.093048:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174964.605045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174965.117030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174965.117180:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174965.628983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174966.141006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174966.141079:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174966.652995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174967.165056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174967.165096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174967.677043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174967.677084:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174967.677097:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174967.677127:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.677158:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00080000:0.0:1786174967.677176:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174967.677188:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174967.677254:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145213440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174967.677295:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174967.677301:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174967.677304:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.677309:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00080000:0.0:1786174967.677314:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174967.677319:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174967.677336:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174967.677354:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145213568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174967.677363:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145213440:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174967.677387:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174967.677395:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174967.677399:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.677410:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00080000:0.0:1786174967.677418:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174967.677426:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174967.677438:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174967.677466:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145213696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174967.677498:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174967.677504:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174967.677511:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174967.677515:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.677524:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00080000:0.0:1786174967.677545:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174967.677561:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174967.677571:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174967.677585:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f2680 x1872931145213440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174967.677596:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145213824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174967.677653:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174967.677659:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174967.677663:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.677673:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00100000:3.0:1786174967.677674:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145213440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174967.677681:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174967.677694:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174967.677708:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786174967.677711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174967.677721:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786174967.677727:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145213952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174967.677743:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145213440:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174967.677744:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174967.677762:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174967.677768:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.677775:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00080000:0.0:1786174967.677779:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174967.677784:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174967.677789:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174967.677800:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145213568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174967.677807:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145214080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174967.677825:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174967.677830:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174967.677833:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.677839:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00080000:0.0:1786174967.677845:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786174967.677847:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174967.677856:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174967.677865:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174967.677878:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f2a00 x1872931145213568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174967.677887:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145214208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174967.677955:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174967.677962:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145213568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174967.677963:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174967.677969:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.677982:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00080000:0.0:1786174967.677993:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174967.678005:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786174967.678011:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786174967.678014:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786174967.678028:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786174967.678038:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145214336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174967.678047:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145213568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174967.678074:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145213696:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174967.678076:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174967.678090:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174967.678093:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174967.678099:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8701
00000100:00080000:0.0:1786174967.678137:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174967.678145:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174967.678153:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786174967.678164:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174967.678178:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145214464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174967.678192:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f0e00 x1872931145213696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174967.678215:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145213696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174967.678236:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174967.678242:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174967.678246:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145213696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174967.678254:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145213824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174967.678279:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174967.678290:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f3480 x1872931145213824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174967.678304:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145213824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174967.678314:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174967.678318:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174967.678321:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145213824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174967.678328:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145213952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174967.678348:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174967.678359:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f2d80 x1872931145213952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174967.678373:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145213952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174967.678382:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174967.678386:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174967.678391:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145213952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174967.678415:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145214080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174967.678436:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174967.678451:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f3b80 x1872931145214080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174967.678466:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145214080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174967.678476:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174967.678479:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174967.678483:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145214080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174967.678489:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145214208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174967.678509:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174967.678521:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f0700 x1872931145214208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174967.678535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145214208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174967.678545:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174967.678548:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174967.678552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145214208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174967.678558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145214336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174967.678586:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174967.678598:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f1880 x1872931145214336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174967.678613:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145214336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174967.678623:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174967.678626:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174967.678630:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145214336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174967.678636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145214464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174967.678654:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174967.678665:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174967/real 1786174967]  req@ffff89d9870f1500 x1872931145214464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174967.678678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145214464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174967.678689:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174967.678692:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174967.678696:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145214464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174968.189058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174968.189138:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174968.700989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174969.213036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174969.213064:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174969.725012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174970.237069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174970.237182:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174970.749042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174971.261037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174971.261152:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174971.773029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174972.285044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174972.285252:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174972.797101:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174972.797130:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174972.797141:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174972.797148:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174972.797164:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.797180:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174972.797193:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174972.797255:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145214592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174972.797307:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174972.797313:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174972.797316:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174972.797321:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.797326:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174972.797332:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174972.797347:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174972.797368:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145214720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174972.797374:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145214592:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174972.797393:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174972.797400:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174972.797404:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174972.797411:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.797416:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174972.797421:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174972.797428:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174972.797446:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145214848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174972.797478:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174972.797485:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174972.797489:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174972.797497:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.797514:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174972.797527:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786174972.797529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786174972.797547:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174972.797577:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145214976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174972.797594:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174972.797599:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174972.797608:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786174972.797608:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f1180 x1872931145214592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174972.797623:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.797636:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174972.797647:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174972.797655:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174972.797658:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145214592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174972.797677:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145215104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174972.797678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174972.797696:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174972.797712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145214592:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174972.797713:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174972.797730:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174972.797733:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174972.797741:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.797747:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174972.797752:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174972.797757:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174972.797769:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145214720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174972.797776:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145215232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174972.797793:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174972.797798:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174972.797801:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174972.797806:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.797812:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786174972.797816:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174972.797824:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174972.797834:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174972.797847:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f0a80 x1872931145214720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174972.797855:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145215360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174972.797945:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145214720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174972.797946:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174972.797962:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174972.797970:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174972.797987:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174972.797988:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.798004:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174972.798006:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174972.798020:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174972.798022:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145214720:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786174972.798036:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174972.798044:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145214848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174972.798091:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145215488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786174972.798108:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174972.798128:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786174972.798134:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f3100 x1872931145214848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174972.798136:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174972.798144:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174972.798163:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8707
00000100:00080000:0.0:1786174972.798172:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786174972.798176:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145214848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174972.798184:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174972.798199:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786174972.798203:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174972.798213:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174972.798226:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145214848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174972.798227:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145215616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786174972.798244:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145214976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174972.798280:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174972.798294:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f1500 x1872931145214976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174972.798315:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145214976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174972.798325:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174972.798328:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174972.798332:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145214976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174972.798339:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145215104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174972.798358:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174972.798369:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f1880 x1872931145215104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174972.798382:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145215104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174972.798392:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174972.798395:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174972.798398:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145215104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174972.798422:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145215232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174972.798442:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174972.798453:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f0700 x1872931145215232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174972.798476:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145215232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174972.798486:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174972.798490:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174972.798493:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145215232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174972.798500:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145215360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786174972.798529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174972.798540:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f3b80 x1872931145215360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174972.798554:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145215360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174972.798564:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174972.798567:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174972.798571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145215360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786174972.798577:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145215488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174972.798594:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174972.798605:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f2d80 x1872931145215488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174972.798619:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145215488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174972.798638:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174972.798642:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174972.798646:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145215488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174972.798652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145215616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174972.798669:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174972.798679:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174972/real 1786174972]  req@ffff89d9870f3480 x1872931145215616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174972.798693:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145215616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786174997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174972.798703:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174972.798706:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786174972.798710:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145215616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174973.309130:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174973.309233:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174973.821007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174974.332991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174974.333072:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174974.845074:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174975.357070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174975.357115:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174975.869101:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174976.381094:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174976.381173:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174976.893050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174977.405042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174977.405125:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174977.916961:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174977.916983:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174977.916988:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174977.916992:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174977.917015:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00080000:0.0:1786174977.917025:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174977.917032:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174977.917066:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145215744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174977.917088:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174977.917091:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174977.917093:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174977.917096:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00080000:0.0:1786174977.917099:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174977.917102:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174977.917112:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174977.917121:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145215744:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786174977.917123:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145215872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174977.917134:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174977.917136:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174977.917137:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174977.917140:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00080000:0.0:1786174977.917142:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174977.917144:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174977.917148:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174977.917157:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145216000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174977.917163:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174977.917166:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174977.917167:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174977.917170:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00080000:0.0:1786174977.917181:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174977.917185:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786174977.917190:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786174977.917191:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174977.917208:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145216128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174977.917219:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174977.917223:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786174977.917227:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f0e00 x1872931145215744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174977.917228:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174977.917238:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00080000:0.0:1786174977.917246:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174977.917251:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174977.917254:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145215744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786174977.917257:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786174977.917267:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786174977.917273:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145216256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174977.917273:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174977.917280:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145215744:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174977.917292:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174977.917294:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174977.917296:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174977.917299:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00080000:0.0:1786174977.917302:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174977.917307:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174977.917307:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145215872:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786174977.917315:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174977.917343:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145216384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174977.917352:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786174977.917352:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174977.917358:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174977.917360:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174977.917364:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00080000:0.0:1786174977.917368:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174977.917370:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f2a00 x1872931145215872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174977.917374:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174977.917380:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174977.917389:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145215872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174977.917394:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145216512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174977.917419:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174977.917420:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174977.917426:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786174977.917429:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174977.917430:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174977.917437:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145215872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174977.917438:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00080000:0.0:1786174977.917444:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174977.917447:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145216000:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174977.917450:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174977.917471:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174977.917481:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145216640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174977.917489:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174977.917491:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174977.917494:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174977.917496:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174977.917501:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8712
00000100:00100000:3.0:1786174977.917502:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f2680 x1872931145216000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174977.917504:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174977.917510:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174977.917514:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174977.917525:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145216768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174977.917530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145216000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174977.917544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174977.917549:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174977.917553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145216000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174977.917561:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145216128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174977.917581:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174977.917606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f3480 x1872931145216128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174977.917617:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145216128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174977.917622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174977.917624:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174977.917629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145216128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174977.917634:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145216256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174977.917658:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174977.917672:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f2d80 x1872931145216256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174977.917690:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145216256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174977.917700:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174977.917704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174977.917707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145216256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174977.917728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145216384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174977.917747:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174977.917755:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f3b80 x1872931145216384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174977.917779:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145216384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174977.917784:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174977.917786:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174977.917789:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145216384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174977.917793:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145216512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174977.917817:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174977.917827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f0700 x1872931145216512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174977.917836:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145216512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174977.917842:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174977.917845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174977.917847:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145216512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174977.917852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145216640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174977.917958:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174977.917970:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f1880 x1872931145216640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174977.917980:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145216640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174977.917986:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174977.917989:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174977.917991:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145216640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174977.917995:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145216768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174977.918120:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174977.918132:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174977/real 1786174977]  req@ffff89d9870f1500 x1872931145216768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174977.918142:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145216768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174977.918182:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174977.918186:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174977.918190:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145216768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174978.429069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174978.429156:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174978.941070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174979.453106:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174979.453151:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174979.965059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174980.477102:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174980.477187:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174980.989083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174981.501017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174981.501104:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174982.013046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174982.525052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174982.525199:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174983.037007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174983.037042:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174983.037051:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174983.037056:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.037068:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00080000:0.0:1786174983.037077:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174983.037085:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174983.037125:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145216896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174983.037157:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174983.037163:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174983.037166:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.037172:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00080000:0.0:1786174983.037179:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174983.037212:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174983.037230:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174983.037235:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145216896:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786174983.037264:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145217024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174983.037291:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174983.037295:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174983.037298:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.037305:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00080000:0.0:1786174983.037312:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174983.037319:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786174983.037326:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786174983.037334:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174983.037358:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145217152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174983.037380:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174983.037386:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f3100 x1872931145216896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174983.037387:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174983.037394:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.037408:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00080000:0.0:1786174983.037415:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174983.037419:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174983.037428:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174983.037445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145216896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174983.037460:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145217280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786174983.037466:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174983.037480:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174983.037493:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145216896:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174983.037503:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174983.037513:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174983.037518:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.037528:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00100000:3.0:1786174983.037535:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145217024:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174983.037539:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174983.037552:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174983.037561:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174983.037581:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145217408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786174983.037591:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174983.037612:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174983.037618:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174983.037620:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.037628:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00100000:3.0:1786174983.037636:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f0a80 x1872931145217024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174983.037637:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174983.037651:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174983.037661:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174983.037708:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145217536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174983.037710:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145217024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174983.037758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786174983.037764:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174983.037765:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174983.037777:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174983.037780:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.037790:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00100000:3.0:1786174983.037790:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145217024:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174983.037796:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174983.037806:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174983.037812:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174983.037813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145217152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174983.037831:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145217664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174983.037843:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174983.037847:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174983.037849:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.037853:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00080000:0.0:1786174983.037858:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786174983.037864:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174983.037869:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174983.037878:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174983.037889:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f1180 x1872931145217152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786174983.037900:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145217792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174983.037929:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174983.037938:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786174983.037939:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145217152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174983.037973:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174983.037979:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174983.037984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145217152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174983.037994:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145217280:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786174983.038004:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174983.038013:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8717
00000100:00080000:0.0:1786174983.038019:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174983.038025:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174983.038032:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786174983.038041:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174983.038054:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145217920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174983.038066:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f1500 x1872931145217280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174983.038092:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145217280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174983.038106:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174983.038111:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174983.038117:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145217280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174983.038145:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145217408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174983.038177:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174983.038190:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f1880 x1872931145217408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174983.038202:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145217408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174983.038228:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174983.038233:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174983.038237:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145217408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174983.038245:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145217536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174983.038267:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174983.038279:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f0700 x1872931145217536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174983.038293:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145217536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174983.038302:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174983.038305:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174983.038310:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145217536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174983.038317:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145217664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174983.038335:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174983.038345:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f3b80 x1872931145217664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174983.038359:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145217664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174983.038369:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174983.038372:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174983.038375:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145217664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174983.038382:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145217792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174983.038399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174983.038409:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f2d80 x1872931145217792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174983.038422:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145217792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174983.038432:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174983.038436:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174983.038440:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145217792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174983.038447:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145217920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174983.038464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174983.038475:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174983/real 1786174983]  req@ffff89d9870f3480 x1872931145217920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174983.038489:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145217920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175008 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174983.038498:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174983.038502:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174983.038505:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145217920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174983.549149:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174983.549174:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174984.061017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174984.573128:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174984.573229:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174985.085093:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174985.597076:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174985.597230:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174986.109081:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174986.621033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174986.621164:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174987.133074:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174987.645173:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174987.645250:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174988.157034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786174988.157132:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174988.157144:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786174988.157152:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174988.157167:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00080000:1.0:1786174988.157179:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174988.157189:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786174988.157238:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145218048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174988.157282:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174988.157287:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174988.157290:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174988.157294:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00080000:1.0:1786174988.157299:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174988.157303:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174988.157314:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174988.157328:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145218176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174988.157341:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174988.157346:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174988.157349:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174988.157355:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00080000:1.0:1786174988.157359:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174988.157366:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174988.157372:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174988.157384:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145218304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174988.157397:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174988.157401:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174988.157403:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174988.157413:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145218048:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786174988.157414:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00080000:1.0:1786174988.157432:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174988.157442:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174988.157454:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786174988.157480:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145218432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174988.157500:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174988.157507:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1786174988.157516:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786174988.157517:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174988.157531:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00080000:1.0:1786174988.157540:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174988.157548:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174988.157556:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174988.157578:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2fdc00 x1872931145218048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174988.157587:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145218560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174988.157620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145218048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174988.157622:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786174988.157644:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786174988.157653:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786174988.157656:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174988.157667:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174988.157669:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00100000:3.0:1786174988.157680:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145218048:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786174988.157685:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786174988.157694:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145218176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174988.157705:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174988.157717:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786174988.157737:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786174988.157751:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145218688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174988.157760:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2ff800 x1872931145218176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174988.157796:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174988.157804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145218176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786174988.157806:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786174988.157813:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174988.157832:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00080000:3.0:1786174988.157835:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786174988.157839:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786174988.157845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174988.157853:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174988.157858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145218176:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786174988.157866:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786174988.157888:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145218816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786174988.157979:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174988.157979:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145218304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174988.157994:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786174988.157997:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786174988.158005:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00080000:1.0:1786174988.158014:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174988.158022:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786174988.158030:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786174988.158038:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174988.158053:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2fe680 x1872931145218304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174988.158072:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145218944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174988.158075:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145218304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174988.158131:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174988.158140:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786174988.158141:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786174988.158148:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145218304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786174988.158153:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786174988.158160:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174988.158164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145218432:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786174988.158173:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8722
00000100:00080000:1.0:1786174988.158183:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786174988.158190:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786174988.158199:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786174988.158202:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174988.158221:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2fce00 x1872931145218432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786174988.158228:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145219072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174988.158266:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145218432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174988.158279:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174988.158284:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174988.158290:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145218432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174988.158299:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145218560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174988.158321:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174988.158332:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2fd180 x1872931145218560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174988.158345:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145218560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174988.158355:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174988.158358:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174988.158361:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145218560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174988.158368:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145218688:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174988.158386:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174988.158397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2fc380 x1872931145218688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174988.158410:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145218688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174988.158420:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174988.158423:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174988.158427:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145218688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174988.158447:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145218816:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174988.158467:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174988.158478:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2fdf80 x1872931145218816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174988.158491:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145218816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174988.158501:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174988.158505:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174988.158509:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145218816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174988.158516:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145218944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174988.158534:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174988.158544:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2ffb80 x1872931145218944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174988.158558:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145218944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174988.158568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174988.158571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174988.158576:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145218944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174988.158583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145219072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174988.158600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174988.158610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174988/real 1786174988]  req@ffff89d9ba2fe300 x1872931145219072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174988.158624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145219072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174988.158634:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174988.158637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174988.158641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145219072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174988.669089:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174988.669151:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174989.181025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174989.693052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174989.693149:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174990.204972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174990.717033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174990.717133:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174991.229007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174991.740996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174991.741081:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174992.253061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174992.765007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174992.765107:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174993.277031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174993.277096:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.277105:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174993.277110:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174993.277121:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00080000:0.0:1786174993.277132:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.277141:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174993.277218:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145219200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174993.277268:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.277272:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174993.277275:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174993.277279:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00080000:0.0:1786174993.277284:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.277290:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174993.277301:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174993.277317:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145219328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174993.277329:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145219200:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174993.277336:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.277341:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174993.277343:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174993.277348:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00080000:0.0:1786174993.277352:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.277366:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174993.277374:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174993.277388:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145219456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174993.277399:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.277403:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174993.277406:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174993.277411:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00080000:0.0:1786174993.277416:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.277422:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174993.277432:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174993.277455:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145219584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174993.277462:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145219328:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786174993.277491:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.277498:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174993.277501:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174993.277510:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00080000:0.0:1786174993.277518:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.277525:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174993.277534:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145219456:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786174993.277537:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174993.277569:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145219712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174993.277584:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.277590:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174993.277594:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174993.277603:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145219584:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786174993.277634:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00080000:0.0:1786174993.277645:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.277654:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174993.277664:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174993.277667:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145219712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786174993.277718:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145219840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174993.277754:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.277762:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174993.277765:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174993.277773:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00080000:0.0:1786174993.277781:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.277791:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174993.277796:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145219840:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786174993.277826:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174993.277904:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145219968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174993.277992:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.277998:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174993.278001:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174993.278010:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00080000:0.0:1786174993.278018:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.278024:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174993.278033:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786174993.278034:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145219968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174993.278061:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145220096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174993.278076:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174993.278080:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174993.278083:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174993.278093:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8727
00000100:00100000:3.0:1786174993.278093:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145220096:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786174993.278098:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174993.278106:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174993.278114:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174993.278132:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145220224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174993.278174:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145220224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174993.789031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174993.789136:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174994.301073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174994.813044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174994.813155:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174995.325004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174995.837003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786174995.837110:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174996.348994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:1.0:1786174996.349189:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:1.0:1786174996.349235:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1786174996.349257:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786174996.349318:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174996.349345:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f2680 x1872931145219200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174996.349377:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145219200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174996.349391:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.349396:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.349401:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145219200:192.168.202.130@tcp:250:kworker.0
00000800:00000100:1.0:1786174996.349504:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786174996.349517:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f1500 x1872931145220224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786174996.349534:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786174996.349550:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786174996.349564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145220224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786174996.349571:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786174996.349593:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786174996.349613:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786174996.349614:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.349626:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.349639:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145220224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786174996.349644:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786174996.349658:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f0700 x1872931145219968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174996.349680:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145219968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174996.349689:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.349693:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.349697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145219968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174996.349705:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f3b80 x1872931145219840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174996.349719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145219840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174996.349728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.349732:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.349736:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145219840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174996.349745:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f3480 x1872931145219584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174996.349760:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145219584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174996.349769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.349773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.349777:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145219584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174996.349878:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f2d80 x1872931145219712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174996.349924:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145219712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174996.349934:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.349940:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.349944:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145219712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174996.349958:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f2a00 x1872931145219328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174996.349976:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145219328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174996.349991:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.349996:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.349999:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145219328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174996.350007:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f0e00 x1872931145219456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174996.350021:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145219456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174996.350030:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.350034:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.350037:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145219456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174996.350075:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174993/real 1786174996]  req@ffff89d9870f1880 x1872931145220096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174996.350090:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145220096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174996.350100:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174996.350104:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174996.350107:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145220096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174996.861063:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174996.861138:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174997.373086:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174997.885058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174997.885144:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174998.397061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786174998.397097:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174998.397111:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786174998.397118:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174998.397138:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.397163:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.397173:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786174998.397223:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145220352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174998.397276:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174998.397284:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174998.397288:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174998.397297:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.397305:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.397327:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174998.397345:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174998.397372:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145220480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174998.397392:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174998.397400:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174998.397405:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174998.397405:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145220352:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174998.397436:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.397443:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.397447:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174998.397456:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174998.397487:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145220608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174998.397506:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174998.397513:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174998.397518:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174998.397527:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.397535:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.397554:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174998.397566:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786174998.397596:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786174998.397613:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145220736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174998.397640:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174998.397650:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174998.397655:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174998.397665:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.397675:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.397685:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786174998.397694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f1180 x1872931145220352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786174998.397700:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174998.397735:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145220864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174998.397874:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145220352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786174998.397884:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786174998.397966:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.397978:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786174998.397990:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786174998.398001:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786174998.398006:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145220352:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786174998.398022:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.398036:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.398046:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174998.398058:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786174998.398073:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145220480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786174998.398092:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145220992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174998.398120:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174998.398128:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786174998.398133:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786174998.398147:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786174998.398158:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.398169:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.398176:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174998.398186:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786174998.398210:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145221120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174998.398227:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174998.398231:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786174998.398233:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174998.398239:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.398244:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.398251:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174998.398260:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174998.398279:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145221248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786174998.398310:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786174998.398317:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786174998.398321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786174998.398329:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8732
00000100:00080000:0.0:1786174998.398336:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786174998.398344:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786174998.398352:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786174998.398373:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145221376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786174998.398475:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f0a80 x1872931145220480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174998.398508:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145220480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174998.398528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.398536:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174998.398543:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145220480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174998.398559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145220608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174998.398612:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174998.398649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f3100 x1872931145220608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174998.398672:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145220608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174998.398690:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.398696:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174998.398710:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145220608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174998.398723:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145220736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174998.398764:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174998.398787:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f1880 x1872931145220736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174998.398839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145220736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174998.398853:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.398859:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174998.398864:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145220736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174998.398877:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145220864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174998.398993:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174998.399016:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f0e00 x1872931145220864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174998.399038:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145220864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174998.399053:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.399059:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174998.399065:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145220864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174998.399104:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145220992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174998.399144:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174998.399165:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f2a00 x1872931145220992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174998.399188:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145220992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174998.399203:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.399210:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174998.399216:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145220992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174998.399228:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145221120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786174998.399264:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174998.399286:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f2d80 x1872931145221120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174998.399308:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145221120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174998.399323:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.399329:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174998.399335:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145221120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786174998.399348:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145221248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174998.399386:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174998.399408:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f3480 x1872931145221248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174998.399429:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145221248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174998.399446:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.399452:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174998.399459:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145221248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786174998.399471:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145221376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786174998.399527:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786174998.399550:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786174998/real 1786174998]  req@ffff89d9870f3b80 x1872931145221376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786174998.399575:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145221376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786174998.399592:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786174998.399598:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786174998.399621:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145221376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786174998.909019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174998.909106:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786174999.421076:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786174999.932980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786174999.933068:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175000.444980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175000.956973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175000.957031:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175001.468971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175001.980999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175001.981114:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175002.493008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175003.004990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175003.005139:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175003.517066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175003.517113:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175003.517125:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175003.517133:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175003.517162:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.517180:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.517192:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175003.517275:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145221504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175003.517326:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175003.517332:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175003.517334:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175003.517340:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.517344:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.517350:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175003.517365:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175003.517389:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145221504:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175003.517390:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145221632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175003.517416:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175003.517421:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175003.517423:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175003.517429:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.517433:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.517438:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175003.517445:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175003.517465:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145221760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175003.517478:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175003.517484:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175003.517486:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175003.517492:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.517499:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.517503:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175003.517509:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175003.517520:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175003.517528:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145221888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175003.517543:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175003.517550:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175003.517564:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175003.517570:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.517575:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.517580:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175003.517587:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175003.517597:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87f100 x1872931145221504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175003.517613:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145222016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175003.517628:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175003.517632:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175003.517634:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175003.517640:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.517646:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.517654:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175003.517659:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145221504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175003.517663:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175003.517686:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145222144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175003.517704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175003.517711:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175003.517719:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175003.517721:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175003.517729:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175003.517734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145221504:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175003.517742:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.517751:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.517794:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175003.517801:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175003.517823:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145221632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175003.517824:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145222272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175003.517851:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175003.517856:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175003.517859:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175003.517867:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.517875:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.517882:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175003.517888:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175003.517894:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175003.517966:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145222400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175003.517982:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175003.517989:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786175003.517994:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87d880 x1872931145221632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175003.517996:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175003.518011:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8737
00000100:00080000:2.0:1786175003.518021:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175003.518030:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175003.518041:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175003.518052:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145221632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175003.518060:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145222528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175003.518098:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175003.518109:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175003.518116:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145221632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175003.518127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145221760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175003.518172:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175003.518187:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87d500 x1872931145221760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175003.518203:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145221760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175003.518214:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175003.518218:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175003.518223:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145221760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175003.518231:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145221888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175003.518253:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175003.518264:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87e680 x1872931145221888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175003.518279:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145221888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175003.518289:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175003.518292:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175003.518296:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145221888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175003.518302:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145222016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175003.518321:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175003.518332:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87c380 x1872931145222016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175003.518346:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145222016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175003.518356:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175003.518359:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175003.518363:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145222016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175003.518369:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145222144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175003.518387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175003.518398:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87c700 x1872931145222144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175003.518413:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145222144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175003.518423:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175003.518426:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175003.518430:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145222144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175003.518454:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145222272:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175003.518475:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175003.518486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87ca80 x1872931145222272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175003.518517:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145222272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175003.518533:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175003.518538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175003.518542:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145222272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175003.518550:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145222400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175003.518573:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175003.518585:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87df80 x1872931145222400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175003.518600:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145222400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175003.518620:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175003.518623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175003.518628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145222400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175003.518634:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145222528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175003.518653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175003.518664:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175003/real 1786175003]  req@ffff89d99e87f800 x1872931145222528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175003.518678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145222528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175003.518699:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175003.518702:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175003.518705:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145222528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175004.029028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175004.029207:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175004.541013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175005.053009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175005.053152:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175005.565027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175006.077013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175006.077114:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175006.589119:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175007.101061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175007.101165:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175007.613024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175008.125016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175008.125140:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175008.636958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175008.636989:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175008.636995:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175008.636999:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175008.637008:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637016:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175008.637024:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175008.637058:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145222656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175008.637079:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175008.637082:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175008.637083:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175008.637087:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637089:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175008.637092:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175008.637100:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175008.637111:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145222784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175008.637117:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145222656:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175008.637134:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175008.637137:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175008.637138:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175008.637142:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637145:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175008.637147:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175008.637151:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175008.637163:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145222912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175008.637171:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175008.637174:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175008.637175:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175008.637177:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637180:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175008.637185:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175008.637188:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175008.637193:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175008.637203:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145223040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175008.637213:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175008.637217:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175008.637219:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175008.637224:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637230:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175008.637234:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87ed80 x1872931145222656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175008.637238:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175008.637248:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175008.637267:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145223168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175008.637277:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175008.637280:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175008.637282:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175008.637287:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145222656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175008.637288:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637294:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175008.637301:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175008.637307:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175008.637308:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786175008.637315:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175008.637325:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145223296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175008.637325:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145222656:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175008.637340:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175008.637343:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175008.637344:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175008.637348:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637350:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175008.637355:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145222784:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175008.637356:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175008.637375:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175008.637386:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175008.637394:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145223424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175008.637401:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87c000 x1872931145222784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175008.637429:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145222784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175008.637436:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175008.637440:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175008.637441:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175008.637446:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175008.637450:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175008.637455:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637461:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175008.637461:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145222784:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175008.637469:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175008.637475:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175008.637476:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145222912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175008.637488:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145223552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175008.637496:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175008.637499:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175008.637500:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175008.637503:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8742
00000100:00080000:2.0:1786175008.637506:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175008.637511:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175008.637514:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175008.637517:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175008.637528:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145223680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175008.637533:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87dc00 x1872931145222912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175008.637549:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145222912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175008.637561:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175008.637564:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175008.637566:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145222912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175008.637571:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145223040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175008.637597:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175008.637604:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87f800 x1872931145223040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175008.637612:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145223040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175008.637618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175008.637620:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175008.637622:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145223040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175008.637626:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145223168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175008.637638:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175008.637643:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87df80 x1872931145223168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175008.637651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145223168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175008.637656:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175008.637658:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175008.637660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145223168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175008.637664:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145223296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175008.637674:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175008.637680:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87ca80 x1872931145223296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175008.637687:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145223296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175008.637692:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175008.637694:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175008.637697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145223296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175008.637728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145223424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175008.637743:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175008.637751:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87c700 x1872931145223424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175008.637760:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145223424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175008.637765:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175008.637768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175008.637770:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145223424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175008.637774:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145223552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175008.637784:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175008.637791:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87c380 x1872931145223552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175008.637799:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145223552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175008.637805:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175008.637806:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175008.637808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145223552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175008.637812:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145223680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175008.637822:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175008.637828:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175008/real 1786175008]  req@ffff89d99e87e680 x1872931145223680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175008.637836:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145223680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175008.637841:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175008.637843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175008.637845:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145223680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175009.149015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175009.149133:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175009.661020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175010.172989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175010.173099:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175010.684965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175011.197039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175011.197108:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175011.708997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175012.220988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175012.221083:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175012.733034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175013.245079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175013.245221:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175013.757063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175013.757080:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175013.757099:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175013.757107:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175013.757126:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.757143:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175013.757159:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175013.757222:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145223808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175013.757268:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175013.757275:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175013.757281:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175013.757289:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.757301:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175013.757308:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175013.757324:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175013.757353:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145223936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175013.757365:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145223808:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175013.757380:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175013.757391:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175013.757396:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175013.757408:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.757419:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175013.757425:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175013.757439:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175013.757459:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145224064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175013.757475:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175013.757488:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175013.757495:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175013.757499:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175013.757507:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.757513:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175013.757517:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175013.757525:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175013.757540:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe64000 x1872931145223808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175013.757546:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145224192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175013.757587:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145223808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175013.757626:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175013.757634:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175013.757643:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145223808:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175013.757711:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175013.757721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145223936:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175013.757721:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175013.757727:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175013.757742:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.757939:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175013.757970:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175013.758008:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe67480 x1872931145223936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175013.758013:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175013.758033:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175013.758044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145223936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175013.758064:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145224320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175013.758068:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175013.758087:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175013.758104:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145223936:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175013.758105:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175013.758121:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175013.758128:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175013.758130:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145224064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175013.758151:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.758163:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175013.758173:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786175013.758179:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175013.758194:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175013.758203:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe66a00 x1872931145224064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175013.758227:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145224448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175013.758236:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145224064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175013.758250:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175013.758264:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175013.758270:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175013.758285:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.758295:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175013.758307:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175013.758319:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175013.758319:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175013.758340:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175013.758342:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145224576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175013.758357:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145224064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175013.758370:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175013.758376:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175013.758379:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175013.758387:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.758393:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175013.758405:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145224192:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175013.758406:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175013.758421:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175013.758443:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145224704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175013.758458:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175013.758468:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175013.758469:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175013.758477:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175013.758487:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8747
00000100:00080000:3.0:1786175013.758494:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175013.758500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe64a80 x1872931145224192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175013.758506:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175013.758519:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175013.758536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145224192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175013.758546:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145224832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175013.758565:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175013.758578:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175013.758585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145224192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175013.758597:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145224320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175013.758639:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175013.758687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe64700 x1872931145224320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175013.758716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145224320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175013.758732:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175013.758737:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175013.758742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145224320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175013.758751:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145224448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175013.758783:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175013.758798:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe65500 x1872931145224448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175013.758813:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145224448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175013.758823:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175013.758826:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175013.758830:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145224448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175013.758837:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145224576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175013.758855:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175013.758866:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe65880 x1872931145224576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175013.758880:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145224576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175013.758890:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175013.758893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175013.758934:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145224576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175013.758964:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145224704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175013.758992:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175013.759008:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe66300 x1872931145224704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175013.759023:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145224704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175013.759036:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175013.759044:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175013.759049:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145224704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175013.759059:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145224832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175013.759089:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175013.759109:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175013/real 1786175013]  req@ffff89d99fe66a00 x1872931145224832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175013.759123:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145224832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175013.759133:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175013.759137:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175013.759140:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145224832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175014.269027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175014.269188:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175014.780964:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175015.292997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175015.293079:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175015.805038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175016.317013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175016.317124:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175016.829016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175017.341021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175017.341186:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175017.853069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175018.365083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175018.365089:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786175018.877005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175018.877034:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175018.877041:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175018.877044:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877059:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00080000:2.0:1786175018.877069:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175018.877075:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175018.877106:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145224960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175018.877128:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175018.877131:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175018.877132:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877135:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00080000:2.0:1786175018.877142:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175018.877148:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175018.877156:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175018.877160:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145224960:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175018.877168:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145225088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175018.877177:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175018.877179:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175018.877180:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877183:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00080000:2.0:1786175018.877185:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175018.877187:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175018.877191:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175018.877199:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145225216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175018.877205:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175018.877207:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175018.877209:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877212:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00080000:2.0:1786175018.877215:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175018.877219:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175018.877224:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175018.877227:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175018.877237:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145225344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175018.877244:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175018.877246:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175018.877248:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877250:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00080000:2.0:1786175018.877253:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175018.877255:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175018.877259:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175018.877262:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87d500 x1872931145224960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175018.877269:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145225472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175018.877278:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175018.877280:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175018.877281:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877287:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00080000:2.0:1786175018.877290:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175018.877296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145224960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175018.877297:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175018.877307:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786175018.877309:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877315:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175018.877319:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145224960:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175018.877324:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145225600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175018.877337:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175018.877342:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145225088:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175018.877343:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175018.877348:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877353:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00080000:2.0:1786175018.877357:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175018.877360:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175018.877365:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175018.877367:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175018.877378:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145225728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175018.877381:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87d880 x1872931145225088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175018.877401:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175018.877408:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175018.877411:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877418:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00100000:3.0:1786175018.877421:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145225088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175018.877422:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175018.877429:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175018.877435:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175018.877438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877443:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175018.877447:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145225856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175018.877448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145225088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175018.877460:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145225216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175018.877464:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175018.877468:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175018.877469:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175018.877473:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8753
00000100:00080000:2.0:1786175018.877477:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175018.877481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175018.877485:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175018.877490:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175018.877495:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87f100 x1872931145225216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175018.877501:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145225984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175018.877527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145225216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175018.877537:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877543:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175018.877548:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145225216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175018.877557:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145225344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175018.877584:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175018.877599:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87e680 x1872931145225344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175018.877633:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145225344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175018.877646:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877648:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175018.877651:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145225344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175018.877657:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145225472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175018.877677:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175018.877686:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87c380 x1872931145225472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175018.877695:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145225472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175018.877701:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175018.877705:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145225472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175018.877710:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145225600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175018.877722:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175018.877730:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87c700 x1872931145225600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175018.877739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145225600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175018.877745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877747:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175018.877750:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145225600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175018.877765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145225728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175018.877778:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175018.877786:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87ca80 x1872931145225728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175018.877794:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145225728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175018.877801:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877803:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175018.877805:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145225728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175018.877826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145225856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175018.877839:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175018.877846:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87df80 x1872931145225856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175018.877855:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145225856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175018.877861:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175018.877865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145225856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175018.877869:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145225984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175018.877880:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175018.877886:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175018/real 1786175018]  req@ffff89d99e87f800 x1872931145225984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175018.877895:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145225984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175018.877901:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175018.877903:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175018.877905:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145225984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175019.388985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175019.389051:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175019.901034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175020.413003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175020.413076:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175020.924993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175021.437062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175021.437140:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175021.948996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175022.461060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175022.461197:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175022.972973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175023.485035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175023.485098:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175023.996979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175023.996979:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175023.996987:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175023.996991:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175023.996999:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997007:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997013:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175023.997044:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145226112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175023.997066:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175023.997069:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175023.997070:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175023.997073:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997076:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997079:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175023.997086:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175023.997098:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145226240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175023.997099:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145226112:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175023.997114:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175023.997119:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175023.997120:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175023.997123:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997125:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997127:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175023.997131:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175023.997141:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145226368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175023.997148:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175023.997150:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175023.997152:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175023.997154:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997156:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997158:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175023.997163:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175023.997164:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175023.997174:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145226496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175023.997180:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175023.997182:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175023.997184:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175023.997186:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997188:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997191:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175023.997195:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175023.997199:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87dc00 x1872931145226112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175023.997207:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145226624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175023.997216:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175023.997218:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175023.997221:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175023.997223:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145226112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175023.997225:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997230:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997235:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175023.997242:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786175023.997248:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175023.997251:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145226752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175023.997259:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175023.997261:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175023.997265:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175023.997268:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175023.997269:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145226112:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175023.997273:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997280:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997283:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175023.997286:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175023.997292:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145226880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175023.997299:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175023.997301:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145226240:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175023.997303:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175023.997308:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175023.997312:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997315:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997317:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175023.997321:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175023.997329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145227008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175023.997334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175023.997343:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175023.997346:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175023.997348:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175023.997351:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87c000 x1872931145226240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175023.997354:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8758
00000100:00080000:2.0:1786175023.997360:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175023.997365:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175023.997372:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175023.997381:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145226240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175023.997384:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145227136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175023.997406:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175023.997411:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175023.997413:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145226240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175023.997419:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145226368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175023.997443:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175023.997450:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87ed80 x1872931145226368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175023.997458:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145226368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175023.997463:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175023.997465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175023.997466:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145226368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175023.997470:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145226496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175023.997480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175023.997486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87f800 x1872931145226496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175023.997503:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145226496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175023.997513:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175023.997515:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175023.997517:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145226496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175023.997520:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145226624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175023.997529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175023.997534:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87df80 x1872931145226624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175023.997541:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145226624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175023.997546:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175023.997548:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175023.997550:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145226624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175023.997553:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145226752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175023.997595:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175023.997603:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87ca80 x1872931145226752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175023.997610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145226752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175023.997616:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175023.997618:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175023.997620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145226752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175023.997635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145226880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175023.997646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175023.997653:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87c700 x1872931145226880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175023.997660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145226880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175023.997665:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175023.997667:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175023.997668:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145226880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175023.997672:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145227008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175023.997682:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175023.997687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87c380 x1872931145227008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175023.997695:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145227008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175023.997700:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175023.997701:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175023.997703:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145227008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175023.997706:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145227136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175023.997715:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175023.997721:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175023/real 1786175023]  req@ffff89d99e87e680 x1872931145227136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175023.997728:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145227136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175023.997733:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175023.997734:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175023.997736:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145227136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175024.509112:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175024.509236:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175025.021047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175025.532991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175025.533138:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175026.044997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175026.556980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175026.557072:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175027.068959:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175027.581003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175027.581078:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175028.092982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175028.605023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175028.605238:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175029.117016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175029.117134:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175029.117145:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175029.117150:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175029.117160:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117171:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117178:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175029.117221:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145227264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175029.117253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175029.117257:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175029.117259:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175029.117263:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117266:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117269:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175029.117279:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175029.117290:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145227392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175029.117303:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175029.117306:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175029.117314:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175029.117316:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145227264:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175029.117324:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117344:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117351:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175029.117357:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175029.117370:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145227520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175029.117380:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175029.117383:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175029.117386:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175029.117391:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117395:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117398:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175029.117405:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175029.117420:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145227648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175029.117434:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175029.117437:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175029.117441:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175029.117443:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175029.117451:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117456:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117461:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175029.117468:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175029.117483:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145227776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175029.117494:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175029.117498:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175029.117500:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175029.117527:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f0700 x1872931145227264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175029.117528:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117537:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117557:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175029.117575:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175029.117592:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145227904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175029.117599:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145227264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.117679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175029.117680:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175029.117692:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175029.117696:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175029.117698:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175029.117706:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145227264:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175029.117710:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117724:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117733:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175029.117745:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175029.117762:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145228032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175029.117775:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175029.117782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145227392:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175029.117783:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175029.117791:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175029.117805:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117813:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117818:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175029.117823:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175029.117836:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145228160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175029.117843:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175029.117864:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175029.117869:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175029.117877:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175029.117877:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f1500 x1872931145227392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175029.117915:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145227392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.117924:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175029.117931:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8763
00000100:00080000:0.0:1786175029.117936:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175029.117941:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175029.117947:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175029.117966:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145228288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175029.117973:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175029.117992:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145227392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175029.118018:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145227520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175029.118045:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175029.118056:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f2680 x1872931145227520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175029.118068:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145227520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.118077:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175029.118080:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175029.118083:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145227520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175029.118090:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145227648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175029.118109:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175029.118123:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f3b80 x1872931145227648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175029.118140:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145227648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.118161:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175029.118166:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175029.118171:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145227648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175029.118181:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145227776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175029.118208:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175029.118220:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f3480 x1872931145227776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175029.118231:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145227776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.118239:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175029.118242:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175029.118244:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145227776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175029.118250:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145227904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175029.118264:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175029.118272:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f2d80 x1872931145227904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175029.118282:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145227904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.118289:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175029.118291:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175029.118295:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145227904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175029.118316:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145228032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175029.118332:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175029.118340:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f2a00 x1872931145228032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175029.118351:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145228032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.118358:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175029.118360:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175029.118363:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145228032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175029.118369:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145228160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175029.118383:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175029.118391:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f0e00 x1872931145228160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175029.118401:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145228160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.118409:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175029.118411:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175029.118414:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145228160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175029.118419:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145228288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175029.118433:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175029.118441:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175029/real 1786175029]  req@ffff89d9870f1880 x1872931145228288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175029.118451:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145228288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175029.118459:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175029.118461:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175029.118464:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145228288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175029.629026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175029.629172:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175030.141068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175030.653046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175030.653182:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175031.165071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175031.677043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175031.677140:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175032.189047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175032.701040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175032.701218:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175033.213055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175033.725020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175033.725163:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175034.237035:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175034.237036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175034.237049:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175034.237055:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175034.237066:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237077:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175034.237085:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175034.237124:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145228416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175034.237155:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175034.237159:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175034.237161:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175034.237164:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237168:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175034.237172:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175034.237181:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175034.237194:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145228544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175034.237203:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145228416:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175034.237211:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175034.237217:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175034.237218:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175034.237234:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237237:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175034.237240:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175034.237246:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175034.237259:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145228672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175034.237269:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175034.237272:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175034.237273:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175034.237277:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237281:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175034.237283:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175034.237289:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175034.237296:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175034.237307:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145228800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175034.237319:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175034.237323:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175034.237325:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175034.237328:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237332:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175034.237336:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175034.237342:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175034.237346:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f3100 x1872931145228416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175034.237358:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145228928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175034.237372:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175034.237378:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145228416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175034.237379:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175034.237385:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175034.237396:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237402:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175034.237405:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175034.237408:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175034.237414:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786175034.237415:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175034.237426:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145228416:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175034.237434:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145229056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175034.237446:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175034.237449:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175034.237452:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175034.237456:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237482:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175034.237485:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145228544:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175034.237491:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175034.237507:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175034.237523:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145229184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175034.237536:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175034.237540:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175034.237543:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175034.237548:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175034.237555:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237561:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175034.237565:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175034.237570:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175034.237574:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f0a80 x1872931145228544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175034.237587:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145229312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175034.237598:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145228544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175034.237601:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175034.237613:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175034.237618:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175034.237626:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175034.237627:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8768
00000100:00080000:0.0:1786175034.237636:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175034.237637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175034.237645:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175034.237649:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145228544:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175034.237652:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175034.237662:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145228672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175034.237670:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145229440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175034.237695:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175034.237712:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f1180 x1872931145228672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175034.237734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145228672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175034.237741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175034.237744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175034.237747:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145228672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175034.237753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145228800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175034.237768:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175034.237776:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f1880 x1872931145228800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175034.237787:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145228800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175034.237827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175034.237833:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175034.237837:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145228800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175034.237846:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145228928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175034.237876:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175034.237896:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f0e00 x1872931145228928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175034.237942:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145228928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175034.237950:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175034.237954:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175034.237957:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145228928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175034.237963:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145229056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175034.237986:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175034.237997:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f2a00 x1872931145229056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175034.238008:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145229056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175034.238015:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175034.238018:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175034.238021:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145229056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175034.238040:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145229184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175034.238056:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175034.238066:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f2d80 x1872931145229184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175034.238077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145229184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175034.238084:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175034.238086:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175034.238089:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145229184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175034.238094:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145229312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175034.238108:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175034.238116:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f3480 x1872931145229312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175034.238127:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145229312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175034.238134:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175034.238136:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175034.238139:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145229312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175034.238144:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145229440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175034.238157:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175034.238166:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175034/real 1786175034]  req@ffff89d9870f3b80 x1872931145229440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175034.238176:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145229440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175034.238184:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175034.238186:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175034.238189:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145229440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175034.749065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175034.749294:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175035.261067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175035.773048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175035.773164:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175036.285028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175036.797018:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175036.797032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786175037.309093:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175037.821035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175037.821107:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175038.332988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175038.845021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175038.845132:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175039.357104:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175039.357107:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175039.357124:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175039.357130:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175039.357143:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357155:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175039.357163:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175039.357202:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145229568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175039.357235:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175039.357239:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175039.357240:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175039.357243:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357246:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175039.357248:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175039.357274:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175039.357288:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145229696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175039.357299:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175039.357302:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175039.357304:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175039.357308:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357311:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175039.357315:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175039.357320:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175039.357331:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145229568:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175039.357338:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145229824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175039.357360:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175039.357363:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175039.357365:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175039.357369:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357374:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175039.357378:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175039.357383:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175039.357398:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145229952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175039.357460:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175039.357463:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175039.357464:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175039.357467:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357474:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175039.357478:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175039.357483:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175039.357493:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145230080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175039.357518:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175039.357520:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175039.357538:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175039.357543:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175039.357550:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357558:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175039.357563:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175039.357569:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175039.357588:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145230208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175039.357620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87f100 x1872931145229568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175039.357626:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175039.357650:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175039.357658:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175039.357673:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357680:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175039.357688:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175039.357689:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145229568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175039.357704:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175039.357727:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145230336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175039.357728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.357747:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175039.357767:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175039.357768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145229568:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175039.357789:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175039.357793:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175039.357799:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145229696:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175039.357800:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357815:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175039.357820:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175039.357824:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175039.357838:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145230464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175039.357846:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175039.357856:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175039.357858:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175039.357862:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175039.357872:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8773
00000100:00080000:2.0:1786175039.357878:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175039.357885:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87d880 x1872931145229696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175039.357887:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175039.357899:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175039.357950:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145230592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175039.357959:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145229696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175039.357989:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.357997:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175039.358005:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145229696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175039.358044:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145229824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175039.358072:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175039.358088:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87d500 x1872931145229824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175039.358103:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145229824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175039.358114:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.358117:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175039.358121:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145229824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175039.358129:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145229952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175039.358150:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175039.358161:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87e680 x1872931145229952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175039.358175:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145229952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175039.358193:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.358197:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175039.358202:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145229952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175039.358208:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145230080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175039.358227:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175039.358238:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87c380 x1872931145230080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175039.358251:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145230080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175039.358261:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.358265:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175039.358268:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145230080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175039.358275:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145230208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175039.358306:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175039.358317:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87c700 x1872931145230208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175039.358330:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145230208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175039.358340:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.358344:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175039.358349:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145230208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175039.358357:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145230336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175039.358377:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175039.358387:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87ca80 x1872931145230336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175039.358401:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145230336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175039.358438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.358442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175039.358446:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145230336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175039.358466:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145230464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175039.358490:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175039.358503:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87df80 x1872931145230464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175039.358517:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145230464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175039.358528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.358532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175039.358536:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145230464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175039.358543:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145230592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175039.358562:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175039.358573:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175039/real 1786175039]  req@ffff89d99e87f800 x1872931145230592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175039.358588:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145230592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175039.358598:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175039.358601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175039.358605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145230592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175039.868984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175039.869034:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175040.381037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175040.893026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175040.893192:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175041.405055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175041.917138:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175041.917192:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175042.429020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175042.941036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175042.941217:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175043.453008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175043.965019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175043.965072:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175044.477023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175044.477060:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477068:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175044.477074:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175044.477086:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8778
00000100:00080000:0.0:1786175044.477099:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175044.477109:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175044.477150:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145230720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175044.477182:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477186:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175044.477188:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175044.477191:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8778
00000100:00080000:0.0:1786175044.477195:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175044.477199:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175044.477209:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175044.477223:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145230848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175044.477230:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145230720:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175044.477241:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477247:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175044.477249:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175044.477253:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8778
00000100:00080000:0.0:1786175044.477257:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175044.477278:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175044.477284:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175044.477305:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145230976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175044.477316:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477321:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175044.477323:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175044.477328:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8778
00000800:00000100:3.0:1786175044.477337:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175044.477338:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175044.477349:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175044.477392:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175044.477429:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145231104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175044.477441:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f2680 x1872931145230720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175044.477443:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477454:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175044.477458:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175044.477470:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8778
00000100:00080000:0.0:1786175044.477475:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175044.477481:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145230720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175044.477482:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175044.477494:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175044.477501:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175044.477509:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145231232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175044.477514:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175044.477530:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145230720:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175044.477531:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477542:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175044.477546:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175044.477552:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8778
00000100:00080000:0.0:1786175044.477555:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175044.477559:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175044.477563:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175044.477578:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145231360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175044.477578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145230848:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175044.477599:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477603:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175044.477605:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175044.477609:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8778
00000100:00080000:0.0:1786175044.477614:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175044.477618:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175044.477624:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175044.477625:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175044.477641:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145231488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175044.477648:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f1500 x1872931145230848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175044.477658:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477691:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175044.477695:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175044.477701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145230848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175044.477716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175044.477717:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8778
00000100:00080000:3.0:1786175044.477728:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175044.477729:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175044.477739:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145230848:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175044.477744:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175044.477757:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175044.477758:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145230976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175044.477786:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145231616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175044.477802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175044.477803:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175044.477810:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175044.477830:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175044.477836:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8778
00000100:00100000:3.0:1786175044.477839:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f0700 x1872931145230976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175044.477842:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175044.477854:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175044.477861:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175044.477863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145230976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175044.477875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175044.477879:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145231744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175044.477883:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175044.477893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145230976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175044.477911:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145231104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175044.477939:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175044.478000:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f3b80 x1872931145231104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175044.478018:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145231104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175044.478033:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175044.478036:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175044.478039:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145231104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175044.478045:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145231232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175044.478068:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175044.478078:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f3480 x1872931145231232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175044.478089:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145231232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175044.478096:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175044.478099:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175044.478103:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145231232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175044.478127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145231360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175044.478159:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175044.478176:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f2d80 x1872931145231360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175044.478193:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145231360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175044.478201:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175044.478204:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175044.478224:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145231360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175044.478232:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145231488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175044.478257:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175044.478269:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f2a00 x1872931145231488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175044.478282:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145231488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175044.478290:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175044.478293:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175044.478297:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145231488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175044.478303:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145231616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175044.478320:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175044.478330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f0e00 x1872931145231616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175044.478342:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145231616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175044.478351:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175044.478354:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175044.478383:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145231616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175044.478392:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145231744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175044.478431:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175044.478442:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175044/real 1786175044]  req@ffff89d9870f1880 x1872931145231744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175044.478453:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145231744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175044.478461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175044.478464:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175044.478467:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145231744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175044.988980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175044.989022:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175045.501049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175046.013072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175046.013138:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175046.525043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175047.037056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175047.037164:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175047.549065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175048.061068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175048.061188:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175048.573076:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175049.085040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175049.085204:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175049.597071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175049.597086:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597097:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175049.597106:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597121:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00080000:0.0:1786175049.597134:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597145:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175049.597197:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145231872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175049.597238:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597245:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175049.597248:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597254:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00080000:0.0:1786175049.597258:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597263:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175049.597275:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175049.597295:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145232000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175049.597332:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597338:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175049.597341:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597353:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00100000:3.0:1786175049.597354:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145231872:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175049.597359:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597376:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175049.597388:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175049.597415:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145232128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175049.597448:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597454:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175049.597458:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597464:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00080000:0.0:1786175049.597473:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597481:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175049.597490:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175049.597523:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145232256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175049.597530:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175049.597547:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597553:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175049.597556:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597563:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00080000:0.0:1786175049.597579:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597584:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175049.597593:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175049.597611:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145232384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175049.597625:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597629:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175049.597631:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597636:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00080000:0.0:1786175049.597641:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597647:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175049.597654:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175049.597668:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145232512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175049.597681:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597686:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175049.597689:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597694:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00080000:0.0:1786175049.597697:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597701:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175049.597708:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175049.597721:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145232640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175049.597745:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597749:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175049.597753:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597761:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00080000:0.0:1786175049.597766:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597772:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175049.597778:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175049.597793:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145232768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175049.597803:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175049.597807:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175049.597810:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175049.597814:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8783
00000100:00080000:0.0:1786175049.597817:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175049.597821:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175049.597825:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175049.597834:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145232896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175049.598074:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f1180 x1872931145231872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.598200:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145231872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.598224:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.598233:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.598241:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145231872:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175049.598282:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145232000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175049.598366:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175049.598395:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f0a80 x1872931145232000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.598423:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145232000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.598441:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.598448:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.598456:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145232000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175049.598470:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145232128:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175049.598512:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175049.598538:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f3100 x1872931145232128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.598565:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145232128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.598583:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.598590:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.598597:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145232128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175049.598609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145232256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175049.598650:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175049.598674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f1880 x1872931145232256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.598698:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145232256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.598729:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.598736:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.598742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145232256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175049.598755:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145232384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175049.598794:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175049.598815:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f0e00 x1872931145232384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.598839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145232384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.598855:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.598861:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.598869:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145232384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175049.598880:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145232512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175049.598979:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175049.599005:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f2a00 x1872931145232512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.599030:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145232512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.599048:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.599054:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.599061:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145232512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175049.599074:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145232640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175049.599119:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175049.599143:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f2d80 x1872931145232640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.599169:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145232640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.599186:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.599191:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.599198:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145232640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175049.599211:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145232768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175049.599252:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175049.599276:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f3480 x1872931145232768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.599338:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145232768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.599357:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.599365:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.599372:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145232768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175049.599385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145232896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175049.599429:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175049.599453:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175049/real 1786175049]  req@ffff89d9870f3b80 x1872931145232896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175049.599479:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145232896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175049.599497:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175049.599503:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175049.599510:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145232896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175050.109105:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175050.109241:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175050.621065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175051.133009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175051.133155:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175051.645153:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175052.157064:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175052.157142:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175052.668980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175053.180989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175053.181195:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175053.693025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175054.205038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175054.205126:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175054.717075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175054.717107:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.717126:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175054.717135:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175054.717172:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:3.0:1786175054.717188:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.717203:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175054.717254:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145233024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175054.717328:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.717334:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175054.717337:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175054.717343:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:3.0:1786175054.717348:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.717389:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175054.717407:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175054.717419:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145233024:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175054.717438:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145233152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175054.717458:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.717464:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175054.717467:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175054.717472:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:3.0:1786175054.717477:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.717481:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175054.717488:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175054.717511:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145233280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175054.717525:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.717529:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175054.717531:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175054.717535:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:3.0:1786175054.717543:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.717549:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175054.717556:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175054.717571:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175054.717574:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145233408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175054.717592:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.717598:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175054.717604:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175054.717611:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:3.0:1786175054.717617:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.717623:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175054.717629:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175054.717646:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145233536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175054.717663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe67480 x1872931145233024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175054.717667:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.717688:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175054.717693:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175054.717707:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:3.0:1786175054.717717:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.717727:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175054.717734:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175054.717760:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145233024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175054.717760:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145233664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175054.717842:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.717848:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175054.717852:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175054.717856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175054.717861:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:2.0:1786175054.717869:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175054.717869:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.717884:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175054.717891:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145233024:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175054.717952:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175054.717973:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145233792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175054.717990:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.717995:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175054.717998:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175054.718001:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145233152:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175054.718016:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:3.0:1786175054.718024:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.718032:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175054.718041:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175054.718058:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145233920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175054.718074:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718105:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe64000 x1872931145233152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175054.718106:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175054.718140:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175054.718148:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175054.718151:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145233152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175054.718176:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8788
00000100:00080000:2.0:1786175054.718187:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175054.718198:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175054.718198:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175054.718219:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145233152:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175054.718240:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175054.718250:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145233280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175054.718296:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145234048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175054.718325:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718350:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe67100 x1872931145233280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175054.718370:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145233280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175054.718383:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175054.718389:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175054.718394:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145233280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175054.718403:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145233408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175054.718427:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718439:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe67b80 x1872931145233408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175054.718453:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145233408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175054.718463:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175054.718466:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175054.718470:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145233408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175054.718477:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145233536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175054.718499:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718511:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe65180 x1872931145233536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175054.718525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145233536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175054.718535:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175054.718538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175054.718542:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145233536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175054.718549:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145233664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175054.718569:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718580:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe64380 x1872931145233664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175054.718594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145233664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175054.718604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175054.718607:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175054.718611:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145233664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175054.718617:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145233792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175054.718637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718648:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe66d80 x1872931145233792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175054.718662:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145233792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175054.718673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175054.718677:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175054.718684:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145233792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175054.718726:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145233920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175054.718768:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718790:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe66680 x1872931145233920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175054.718808:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145233920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175054.718819:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175054.718824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175054.718828:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145233920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175054.718836:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145234048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175054.718862:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175054.718875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175054/real 1786175054]  req@ffff89d99fe67800 x1872931145234048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175054.718889:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145234048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175054.718932:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175054.718936:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175054.718941:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145234048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175055.229029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175055.229141:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175055.741059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175056.253068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175056.253168:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175056.765019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175057.277017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175057.277140:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175057.789028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175058.301061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175058.301216:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175058.813089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175059.325121:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175059.325153:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175059.837002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175059.837051:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175059.837058:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175059.837064:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175059.837076:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837088:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837107:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175059.837176:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145234176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175059.837236:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175059.837242:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175059.837245:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175059.837251:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837274:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837278:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175059.837291:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145234176:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786175059.837292:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175059.837309:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145234304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175059.837320:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175059.837323:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175059.837325:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175059.837329:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837332:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837336:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175059.837341:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175059.837376:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145234432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175059.837386:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175059.837391:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175059.837393:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175059.837397:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837402:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837406:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175059.837412:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175059.837426:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145234560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175059.837435:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175059.837440:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175059.837442:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175059.837446:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837449:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837452:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175059.837457:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175059.837488:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145234688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175059.837504:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175059.837511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145234304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175059.837512:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175059.837520:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175059.837532:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837538:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837544:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175059.837551:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175059.837562:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145234432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175059.837570:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145234816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175059.837582:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175059.837586:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175059.837591:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175059.837602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145234560:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175059.837604:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837614:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837620:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175059.837625:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175059.837638:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145234944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175059.837643:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145234688:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175059.837662:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175059.837667:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175059.837669:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175059.837677:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837684:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837697:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175059.837697:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145234816:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175059.837709:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175059.837730:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145235072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175059.837741:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175059.837745:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786175059.837748:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145234944:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175059.837749:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175059.837759:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8794
00000100:00080000:2.0:1786175059.837764:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175059.837769:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175059.837775:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175059.837790:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145235200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175059.837798:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145235072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175059.837825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145235200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175060.349095:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175060.349197:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175060.861089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175061.373145:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175061.373224:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175061.885044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175062.397068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175062.397156:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175062.909056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786175062.909318:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786175062.909369:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786175062.909388:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786175062.909520:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87ed80 x1872931145234176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786175062.909535:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175062.909572:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145234176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175062.909598:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000800:00000100:0.0:1786175062.909610:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786175062.909616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.909630:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145234176:192.168.202.130@tcp:250:kworker.0
00000800:00000100:0.0:1786175062.909646:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175062.909670:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786175062.909687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87e680 x1872931145235200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786175062.909691:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175062.909720:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786175062.909740:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145235200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786175062.909751:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786175062.909777:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:0.0:1786175062.909778:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786175062.909796:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.909820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145235200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175062.909838:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87c380 x1872931145235072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175062.909866:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145235072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175062.909884:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175062.909934:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.909941:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145235072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175062.909955:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87ca80 x1872931145234816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175062.909981:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145234816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175062.909997:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175062.910003:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.910010:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145234816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175062.910022:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87c700 x1872931145234944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175062.910042:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145234944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175062.910055:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175062.910061:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.910067:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145234944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175062.910078:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87c000 x1872931145234304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175062.910099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145234304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175062.910113:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175062.910120:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.910285:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145234304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175062.910301:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87dc00 x1872931145234432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175062.910329:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145234432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175062.910345:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175062.910352:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.910358:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145234432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175062.910372:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87f800 x1872931145234560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175062.910395:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145234560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175062.910411:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175062.910417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.910423:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145234560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175062.910435:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175059/real 1786175062]  req@ffff89d99e87df80 x1872931145234688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175062.910457:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145234688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175062.910471:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175062.910478:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175062.910484:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145234688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175063.421056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175063.421272:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175063.933024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175064.445066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175064.445345:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175064.957034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175064.957039:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175064.957048:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175064.957053:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175064.957062:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8799
00000100:00080000:3.0:1786175064.957073:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175064.957081:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175064.957119:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145235328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175064.957150:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175064.957154:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175064.957156:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175064.957177:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8799
00000100:00080000:3.0:1786175064.957182:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175064.957187:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175064.957214:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175064.957239:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145235456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175064.957252:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145235328:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175064.957257:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175064.957284:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175064.957287:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175064.957292:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8799
00000100:00080000:3.0:1786175064.957298:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175064.957304:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175064.957312:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175064.957331:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145235584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175064.957345:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175064.957350:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175064.957354:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175064.957362:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175064.957365:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8799
00000100:00080000:3.0:1786175064.957375:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175064.957382:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175064.957390:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175064.957408:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145235712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175064.957419:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe65f80 x1872931145235328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175064.957421:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175064.957429:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175064.957433:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175064.957443:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8799
00000100:00080000:3.0:1786175064.957449:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175064.957454:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175064.957459:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175064.957467:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145235328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175064.957472:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145235840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175064.957515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175064.957516:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175064.957528:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175064.957532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175064.957533:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175064.957544:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145235328:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175064.957547:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8799
00000100:00080000:3.0:1786175064.957559:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175064.957565:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175064.957572:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175064.957592:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145235968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175064.957602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145235456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175064.957630:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175064.957636:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175064.957639:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175064.957646:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8799
00000800:00000100:2.0:1786175064.957653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175064.957654:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175064.957666:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175064.957673:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175064.957684:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe67800 x1872931145235456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175064.957694:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145236096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175064.957721:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175064.957724:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145235456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175064.957728:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175064.957734:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175064.957749:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8799
00000100:00080000:2.0:1786175064.957755:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175064.957764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175064.957769:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145235456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175064.957771:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175064.957783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145235584:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175064.957784:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175064.957797:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175064.957815:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145236224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175064.957827:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175064.957832:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175064.957834:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175064.957840:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8799
00000800:00000100:2.0:1786175064.957848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175064.957848:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175064.957859:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175064.957867:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175064.957877:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe66680 x1872931145235584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175064.957886:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145236352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175064.957945:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145235584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175064.957958:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175064.957971:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175064.957977:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145235584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175064.957987:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145235712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175064.958020:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175064.958036:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe66d80 x1872931145235712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175064.958063:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145235712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175064.958082:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175064.958086:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175064.958090:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145235712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175064.958099:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145235840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175064.958130:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175064.958148:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe64380 x1872931145235840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175064.958184:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145235840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175064.958195:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175064.958199:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175064.958204:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145235840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175064.958237:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145235968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175064.958268:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175064.958284:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe65180 x1872931145235968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175064.958301:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145235968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175064.958320:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175064.958324:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175064.958329:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145235968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175064.958337:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145236096:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175064.958366:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175064.958383:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe67b80 x1872931145236096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175064.958412:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145236096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175064.958423:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175064.958428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175064.958432:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145236096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175064.958442:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145236224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175064.958472:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175064.958490:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe67100 x1872931145236224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175064.958508:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145236224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175064.958519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175064.958523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175064.958529:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145236224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175064.958538:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145236352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175064.958567:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175064.958583:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175064/real 1786175064]  req@ffff89d99fe64000 x1872931145236352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175064.958598:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145236352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175064.958624:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175064.958629:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175064.958633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145236352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175065.469045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175065.469200:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175065.980989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175066.493008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175066.493088:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175067.005060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175067.517050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175067.517218:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175068.029050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175068.541059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175068.541202:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175069.053055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175069.565032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175069.565223:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175070.077076:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175070.077081:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175070.077104:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175070.077149:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175070.077174:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8804
00000100:00080000:3.0:1786175070.077192:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175070.077205:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175070.077263:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145236480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175070.077312:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175070.077317:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175070.077320:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175070.077326:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8804
00000100:00080000:3.0:1786175070.077332:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175070.077337:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175070.077353:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175070.077386:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145236608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175070.077397:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145236480:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175070.077436:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175070.077445:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175070.077450:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175070.077462:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8804
00000100:00080000:3.0:1786175070.077468:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175070.077475:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175070.077484:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175070.077507:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145236736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175070.077522:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175070.077528:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175070.077530:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175070.077540:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8804
00000800:00000100:2.0:1786175070.077541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175070.077555:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175070.077563:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175070.077572:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175070.077590:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145236864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175070.077603:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175070.077608:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175070.077610:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175070.077619:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8804
00000100:00080000:3.0:1786175070.077626:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175070.077632:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175070.077642:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175070.077645:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe67480 x1872931145236480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175070.077661:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145236992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175070.077734:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175070.077745:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145236480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175070.077746:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175070.077757:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175070.077783:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8804
00000100:00080000:2.0:1786175070.077788:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175070.077792:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175070.077807:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175070.077813:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175070.077820:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175070.077834:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145236480:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175070.077846:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145237120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175070.077862:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175070.077866:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175070.077869:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175070.077874:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8804
00000100:00080000:3.0:1786175070.077878:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175070.077886:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175070.077892:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175070.077944:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145236608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175070.077977:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145237248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175070.077997:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175070.078010:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175070.078014:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175070.078021:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175070.078031:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8804
00000100:00080000:3.0:1786175070.078037:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175070.078047:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175070.078049:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe66a00 x1872931145236608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175070.078058:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175070.078091:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145237376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175070.078093:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145236608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175070.078220:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175070.078222:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175070.078231:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175070.078236:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175070.078243:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175070.078252:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8804
00000100:00080000:3.0:1786175070.078267:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175070.078276:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145236608:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175070.078282:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175070.078295:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175070.078312:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145236736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175070.078321:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145237504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175070.078371:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175070.078391:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe66300 x1872931145236736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175070.078408:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145236736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175070.078421:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175070.078426:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175070.078430:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145236736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175070.078439:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145236864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175070.078463:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175070.078474:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe65880 x1872931145236864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175070.078489:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145236864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175070.078500:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175070.078504:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175070.078507:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145236864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175070.078514:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145236992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175070.078534:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175070.078545:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe65500 x1872931145236992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175070.078558:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145236992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175070.078568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175070.078573:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175070.078576:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145236992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175070.078583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145237120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175070.078616:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175070.078637:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe64700 x1872931145237120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175070.078660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145237120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175070.078678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175070.078685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175070.078693:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145237120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175070.078732:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145237248:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175070.078764:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175070.078785:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe64a80 x1872931145237248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175070.078809:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145237248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175070.078826:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175070.078833:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175070.078840:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145237248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175070.078854:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145237376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175070.078927:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175070.078947:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe67480 x1872931145237376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175070.078963:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145237376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175070.078974:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175070.078979:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175070.078983:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145237376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175070.078992:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145237504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175070.079018:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175070.079030:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175070/real 1786175070]  req@ffff89d99fe64000 x1872931145237504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175070.079045:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145237504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175095 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175070.079056:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175070.079059:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175070.079063:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145237504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175070.589091:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175070.589103:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175071.101158:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175071.613062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175071.613175:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175072.124986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175072.637019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175072.637083:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175073.149059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175073.661019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175073.661164:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175074.173026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175074.685110:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175074.685240:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175075.197051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175075.197091:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197102:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175075.197108:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175075.197121:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197134:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175075.197142:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175075.197202:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145237632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175075.197255:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197261:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175075.197263:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175075.197269:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197274:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175075.197280:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175075.197296:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175075.197321:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145237760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175075.197327:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145237632:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175075.197341:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197348:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175075.197351:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175075.197357:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197377:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175075.197381:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175075.197385:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175075.197396:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145237888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175075.197404:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197407:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175075.197408:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175075.197411:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197414:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175075.197416:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175075.197420:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175075.197428:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145238016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175075.197435:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197438:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175075.197442:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175075.197443:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175075.197448:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197451:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175075.197455:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175075.197460:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175075.197469:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145238144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175075.197476:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197479:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175075.197481:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175075.197484:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197487:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175075.197491:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175075.197495:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175075.197499:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f0700 x1872931145237632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175075.197508:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145238272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175075.197518:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197522:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175075.197524:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175075.197525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145237632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175075.197532:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197539:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175075.197544:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175075.197546:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175075.197547:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175075.197553:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175075.197558:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145238400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175075.197561:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145237632:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175075.197577:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197580:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175075.197581:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175075.197586:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197589:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175075.197591:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175075.197595:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175075.197599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145237760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175075.197607:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145238528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175075.197617:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175075.197619:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175075.197620:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175075.197624:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8809
00000100:00080000:0.0:1786175075.197627:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175075.197631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175075.197634:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175075.197641:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175075.197651:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145238656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175075.197668:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f1500 x1872931145237760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175075.197688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145237760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175075.197701:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175075.197704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175075.197706:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145237760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175075.197712:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145237888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175075.197731:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175075.197740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f2680 x1872931145237888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175075.197749:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145237888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175075.197756:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175075.197758:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175075.197761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145237888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175075.197765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145238016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175075.197777:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175075.197783:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f3b80 x1872931145238016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175075.197792:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145238016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175075.197798:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175075.197799:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175075.197802:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145238016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175075.197806:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145238144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175075.197818:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175075.197825:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f3480 x1872931145238144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175075.197832:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145238144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175075.197838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175075.197840:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175075.197842:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145238144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175075.197846:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145238272:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175075.197858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175075.197865:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f2d80 x1872931145238272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175075.197874:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145238272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175075.197880:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175075.197882:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175075.197884:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145238272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175075.197887:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145238400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175075.197923:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175075.197933:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f2a00 x1872931145238400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175075.197942:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145238400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175075.197949:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175075.197951:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175075.197954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145238400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175075.197972:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145238528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175075.197985:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175075.197993:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f0e00 x1872931145238528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175075.198006:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145238528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175075.198016:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175075.198020:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175075.198024:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145238528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175075.198031:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145238656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175075.198055:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175075.198084:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175075/real 1786175075]  req@ffff89d9870f1880 x1872931145238656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175075.198094:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145238656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175075.198102:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175075.198105:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175075.198107:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145238656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175075.709052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175075.709128:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175076.221020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175076.733107:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175076.733240:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175077.245027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175077.757073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175077.757175:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175078.269122:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175078.781080:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175078.781225:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175079.293103:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175079.805053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175079.805193:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175080.317036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175080.317081:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175080.317089:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175080.317096:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175080.317108:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00080000:2.0:1786175080.317121:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175080.317131:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175080.317186:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145238784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175080.317220:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175080.317225:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175080.317227:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175080.317233:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00080000:2.0:1786175080.317239:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175080.317245:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175080.317258:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145238784:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786175080.317259:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175080.317280:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145238912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175080.317293:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175080.317297:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175080.317300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175080.317305:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00080000:2.0:1786175080.317323:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175080.317329:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175080.317335:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175080.317341:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175080.317354:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145239040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175080.317366:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175080.317369:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175080.317372:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175080.317377:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00080000:2.0:1786175080.317382:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175080.317388:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87d500 x1872931145238784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175080.317389:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175080.317399:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175080.317409:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145238784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175080.317417:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145239168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175080.317422:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175080.317431:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175080.317434:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175080.317437:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145238784:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175080.317441:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175080.317444:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175080.317450:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00080000:2.0:1786175080.317455:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175080.317460:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175080.317464:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145238912:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175080.317466:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175080.317486:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145239296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175080.317490:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175080.317504:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175080.317504:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87d880 x1872931145238912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175080.317515:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175080.317520:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175080.317525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145238912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175080.317529:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00080000:2.0:1786175080.317537:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175080.317546:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175080.317548:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175080.317553:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786175080.317554:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175080.317556:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145238912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175080.317564:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145239040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175080.317573:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145239424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175080.317582:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175080.317591:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175080.317594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87f100 x1872931145239040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175080.317599:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175080.317603:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175080.317613:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00100000:3.0:1786175080.317614:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145239040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175080.317621:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175080.317625:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175080.317629:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175080.317632:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175080.317636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145239040:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175080.317637:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175080.317652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145239168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175080.317661:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145239552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175080.317669:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175080.317674:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:3.0:1786175080.317674:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175080.317677:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175080.317684:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00100000:3.0:1786175080.317688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87df80 x1872931145239168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175080.317689:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175080.317698:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175080.317706:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175080.317710:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145239168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175080.317718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175080.317720:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145239680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175080.317723:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175080.317731:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145239168:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175080.317737:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175080.317741:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175080.317743:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175080.317747:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8814
00000100:00080000:2.0:1786175080.317750:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175080.317752:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145239296:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175080.317756:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175080.317762:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175080.317773:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145239808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175080.317778:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175080.317791:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87f800 x1872931145239296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175080.317801:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145239296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175080.317807:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175080.317810:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175080.317812:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145239296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175080.317816:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145239424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175080.317826:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175080.317832:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87dc00 x1872931145239424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175080.317839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145239424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175080.317845:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175080.317847:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175080.317848:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145239424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175080.317852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145239552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175080.317862:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175080.317868:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87c000 x1872931145239552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175080.317875:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145239552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175080.317881:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175080.317882:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175080.317884:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145239552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175080.317887:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145239680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175080.317921:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175080.317929:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87c700 x1872931145239680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175080.317939:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145239680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175080.317948:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175080.317951:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175080.317954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145239680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175080.317966:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145239808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175080.317979:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175080.317985:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175080/real 1786175080]  req@ffff89d99e87ca80 x1872931145239808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175080.317993:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145239808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175080.317999:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175080.318001:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175080.318003:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145239808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175080.829004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175080.829112:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175081.341117:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175081.853059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175081.853268:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175082.365044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175082.877143:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175082.877280:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175083.389101:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175083.901031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175083.901054:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175084.412993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175084.925039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175084.925166:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175085.437046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175085.437056:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437068:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175085.437074:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175085.437088:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:2.0:1786175085.437102:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175085.437115:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175085.437163:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145239936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175085.437204:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437211:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175085.437215:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175085.437222:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:2.0:1786175085.437229:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175085.437237:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145239936:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175085.437239:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175085.437259:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175085.437291:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145240064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175085.437317:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437326:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175085.437331:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175085.437341:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175085.437344:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:2.0:1786175085.437359:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175085.437370:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175085.437382:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175085.437411:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87c380 x1872931145239936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175085.437416:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145240192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175085.437430:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437435:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175085.437438:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175085.437444:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:2.0:1786175085.437451:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175085.437457:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175085.437467:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175085.437486:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145240320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175085.437500:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437504:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175085.437507:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175085.437512:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:2.0:1786175085.437515:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175085.437520:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175085.437530:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175085.437547:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145240448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175085.437562:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437570:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786175085.437571:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145239936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175085.437574:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175085.437589:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:2.0:1786175085.437600:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175085.437606:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175085.437611:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175085.437622:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145240576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175085.437632:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437637:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175085.437640:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175085.437646:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:2.0:1786175085.437650:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175085.437654:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175085.437659:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175085.437671:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145240704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175085.437681:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437686:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175085.437689:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175085.437694:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:2.0:1786175085.437698:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175085.437702:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175085.437708:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175085.437727:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145240832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175085.437745:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175085.437752:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175085.437760:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175085.437763:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175085.437772:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8819
00000100:00080000:3.0:1786175085.437781:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175085.437787:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175085.437791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145239936:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175085.437804:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175085.437817:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175085.437842:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145240960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175085.437941:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145240064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175085.438015:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175085.438036:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87e680 x1872931145240064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175085.438054:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145240064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175085.438067:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175085.438071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175085.438076:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145240064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175085.438084:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145240192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175085.438106:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175085.438118:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87ed80 x1872931145240192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175085.438132:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145240192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175085.438142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175085.438146:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175085.438149:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145240192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175085.438156:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145240320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175085.438175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175085.438186:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87ca80 x1872931145240320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175085.438201:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145240320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175085.438210:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175085.438213:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175085.438217:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145240320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175085.438224:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145240448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175085.438242:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175085.438252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87c700 x1872931145240448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175085.438265:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145240448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175085.438274:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175085.438278:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175085.438282:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145240448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175085.438288:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145240576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175085.438306:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175085.438317:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87c000 x1872931145240576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175085.438330:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145240576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175085.438339:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175085.438343:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175085.438346:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145240576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175085.438353:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145240704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175085.438370:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175085.438382:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87dc00 x1872931145240704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175085.438395:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145240704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175085.438405:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175085.438408:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175085.438412:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145240704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175085.438418:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145240832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175085.438436:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175085.438446:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87f800 x1872931145240832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175085.438459:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145240832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175085.438469:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175085.438473:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175085.438477:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145240832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175085.438483:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145240960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175085.438500:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175085.438511:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175085/real 1786175085]  req@ffff89d99e87df80 x1872931145240960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175085.438524:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145240960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175085.438535:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175085.438539:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175085.438543:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145240960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175085.948997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175085.949095:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175086.461032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175086.973077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175086.973196:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175087.485064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175087.996979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175087.997053:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175088.509075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175089.021073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175089.021204:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175089.533114:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175090.045043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175090.045154:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175090.557075:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175090.557078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175090.557101:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175090.557107:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175090.557123:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00080000:2.0:1786175090.557139:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175090.557152:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175090.557211:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145241088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175090.557288:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175090.557290:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145241088:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175090.557300:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175090.557307:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175090.557315:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00080000:2.0:1786175090.557322:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175090.557329:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175090.557342:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175090.557366:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145241216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175090.557383:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175090.557384:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175090.557393:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175090.557397:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175090.557408:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00080000:2.0:1786175090.557417:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175090.557427:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175090.557438:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175090.557444:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87f100 x1872931145241088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175090.557470:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145241344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175090.557475:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145241088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175090.557524:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175090.557526:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175090.557538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175090.557539:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175090.557547:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175090.557552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145241088:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175090.557559:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00080000:2.0:1786175090.557571:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175090.557578:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175090.557587:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175090.557595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145241216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175090.557608:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145241472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175090.557626:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175090.557635:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175090.557637:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175090.557644:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175090.557653:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00080000:2.0:1786175090.557660:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175090.557666:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87d880 x1872931145241216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175090.557670:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175090.557683:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175090.557704:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145241216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175090.557721:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145241600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175090.557783:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175090.557784:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175090.557797:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175090.557800:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175090.557803:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175090.557814:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00100000:3.0:1786175090.557821:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145241216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175090.557822:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175090.557834:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175090.557842:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145241344:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175090.557844:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175090.557868:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145241728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175090.557881:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175090.557965:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87d500 x1872931145241344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175090.557968:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175090.557984:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175090.557991:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175090.558001:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00100000:3.0:1786175090.558005:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145241344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175090.558009:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175090.558022:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175090.558028:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175090.558033:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786175090.558039:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175090.558047:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145241344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175090.558061:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145241856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175090.558076:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145241472:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175090.558086:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175090.558096:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175090.558099:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175090.558105:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00080000:2.0:1786175090.558122:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175090.558124:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175090.558135:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175090.558146:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175090.558149:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87f100 x1872931145241472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175090.558166:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145241984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175090.558173:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145241472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175090.558203:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175090.558207:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175090.558211:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175090.558217:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175090.558218:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175090.558236:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145241472:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175090.558237:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8824
00000100:00080000:2.0:1786175090.558247:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175090.558259:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175090.558260:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145241600:192.168.202.130@tcp:8:kworker.0
00000008:00100000:2.0:1786175090.558266:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175090.558287:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145242112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175090.558300:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175090.558325:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87df80 x1872931145241600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175090.558343:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145241600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175090.558353:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175090.558357:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175090.558361:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145241600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175090.558368:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145241728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175090.558387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175090.558397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87f800 x1872931145241728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175090.558411:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145241728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175090.558421:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175090.558424:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175090.558428:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145241728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175090.558444:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145241856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175090.558463:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175090.558475:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87dc00 x1872931145241856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175090.558489:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145241856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175090.558499:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175090.558502:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175090.558506:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145241856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175090.558512:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145241984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175090.558531:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175090.558541:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87c000 x1872931145241984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175090.558556:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145241984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175090.558565:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175090.558568:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175090.558572:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145241984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175090.558578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145242112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175090.558595:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175090.558606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175090/real 1786175090]  req@ffff89d99e87c700 x1872931145242112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175090.558619:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145242112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175090.558630:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175090.558634:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175090.558637:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145242112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175091.069035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175091.069147:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175091.581024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175092.093017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175092.093116:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175092.605078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175093.117078:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175093.117192:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175093.629071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175094.141037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175094.141141:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175094.653085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175095.165023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175095.165121:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175095.677038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175095.677098:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175095.677109:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175095.677114:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677127:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00080000:0.0:1786175095.677139:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175095.677148:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175095.677193:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145242240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175095.677234:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175095.677239:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175095.677241:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677246:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00080000:0.0:1786175095.677251:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175095.677256:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175095.677269:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175095.677292:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145242368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175095.677293:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145242240:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175095.677321:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175095.677326:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175095.677329:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677334:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00080000:0.0:1786175095.677339:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175095.677343:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175095.677350:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175095.677366:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145242496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175095.677379:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175095.677383:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175095.677385:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677389:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00080000:0.0:1786175095.677395:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175095.677400:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175095.677408:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175095.677414:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175095.677435:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145242624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175095.677448:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175095.677453:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175095.677456:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677462:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00080000:0.0:1786175095.677468:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175095.677476:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f3100 x1872931145242240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175095.677480:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175095.677493:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175095.677520:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145242752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175095.677526:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145242240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175095.677558:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175095.677562:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175095.677564:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677580:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00080000:3.0:1786175095.677584:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175095.677586:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175095.677598:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175095.677599:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175095.677610:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175095.677611:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145242240:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175095.677631:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145242880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175095.677654:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145242368:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175095.677657:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175095.677669:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175095.677671:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677679:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00080000:0.0:1786175095.677684:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175095.677690:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175095.677697:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175095.677706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175095.677717:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145243008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175095.677732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f0a80 x1872931145242368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175095.677735:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175095.677752:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175095.677760:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677774:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00100000:3.0:1786175095.677781:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145242368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175095.677784:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175095.677799:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175095.677813:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175095.677815:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175095.677826:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175095.677838:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145243136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175095.677839:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145242368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175095.677861:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145242496:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175095.677952:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175095.677953:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175095.677964:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175095.677968:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175095.677976:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8829
00000100:00100000:3.0:1786175095.677981:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f1180 x1872931145242496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175095.677986:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175095.678001:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175095.678017:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175095.678023:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145242496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175095.678039:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175095.678042:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145243264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175095.678049:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175095.678063:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145242496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175095.678082:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145242624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175095.678110:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175095.678122:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f1880 x1872931145242624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175095.678137:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145242624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175095.678147:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175095.678150:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175095.678155:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145242624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175095.678162:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145242752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175095.678181:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175095.678191:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f0e00 x1872931145242752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175095.678205:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145242752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175095.678214:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175095.678218:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175095.678221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145242752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175095.678243:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145242880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175095.678262:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175095.678275:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f2a00 x1872931145242880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175095.678289:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145242880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175095.678299:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175095.678302:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175095.678306:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145242880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175095.678312:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145243008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175095.678331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175095.678343:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f2d80 x1872931145243008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175095.678357:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145243008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175095.678366:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175095.678370:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175095.678373:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145243008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175095.678379:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145243136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175095.678397:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175095.678407:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f3480 x1872931145243136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175095.678420:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145243136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175095.678430:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175095.678433:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175095.678437:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145243136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175095.678443:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145243264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175095.678459:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175095.678470:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175095/real 1786175095]  req@ffff89d9870f3b80 x1872931145243264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175095.678482:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145243264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175095.678493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175095.678497:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175095.678501:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145243264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175096.189059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175096.189102:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175096.701005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175097.213025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175097.213166:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175097.725037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175098.237049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175098.237125:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175098.748983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175099.260979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175099.261072:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175099.773101:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175100.285073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175100.285190:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175100.797017:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175100.797031:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175100.797038:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175100.797038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175100.797056:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:1.0:1786175100.797070:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175100.797079:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175100.797130:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145243392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175100.797180:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175100.797185:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175100.797188:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175100.797192:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:1.0:1786175100.797196:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175100.797201:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175100.797215:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175100.797232:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145243520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175100.797239:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145243392:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175100.797252:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175100.797257:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175100.797259:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175100.797266:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:1.0:1786175100.797271:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175100.797278:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175100.797286:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175100.797310:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145243648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175100.797328:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175100.797354:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175100.797357:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175100.797363:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175100.797365:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:1.0:1786175100.797372:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175100.797377:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175100.797383:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175100.797398:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145243776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175100.797407:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175100.797410:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175100.797412:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175100.797416:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:1.0:1786175100.797420:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175100.797422:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2fd500 x1872931145243392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175100.797426:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175100.797433:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175100.797449:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145243904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175100.797455:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145243392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175100.797470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175100.797476:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175100.797478:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175100.797479:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175100.797484:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:3.0:1786175100.797488:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175100.797490:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175100.797496:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145243392:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175100.797498:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175100.797507:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175100.797517:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145244032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175100.797524:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175100.797528:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175100.797530:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175100.797533:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145243520:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175100.797538:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:1.0:1786175100.797543:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175100.797546:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175100.797552:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175100.797565:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175100.797567:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145244160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175100.797579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175100.797582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2fea00 x1872931145243520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175100.797584:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175100.797588:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175100.797599:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:1.0:1786175100.797604:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175100.797607:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145243520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175100.797611:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175100.797620:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175100.797642:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175100.797650:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175100.797655:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145244288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175100.797660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145243520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175100.797678:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145243648:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175100.797681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175100.797686:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175100.797689:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175100.797695:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8835
00000100:00080000:1.0:1786175100.797701:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175100.797706:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175100.797713:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786175100.797716:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175100.797730:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2ff100 x1872931145243648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175100.797737:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145244416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175100.797776:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145243648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175100.797787:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175100.797791:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175100.797796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145243648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175100.797804:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145243776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175100.797848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175100.797876:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2fe300 x1872931145243776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175100.797887:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145243776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175100.797893:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175100.797896:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175100.797899:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145243776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175100.797904:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145243904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175100.797951:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175100.797962:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2ffb80 x1872931145243904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175100.797972:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145243904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175100.797978:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175100.797981:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175100.797984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145243904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175100.797992:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145244032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175100.798015:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175100.798030:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2fdf80 x1872931145244032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175100.798046:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145244032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175100.798057:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175100.798062:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175100.798065:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145244032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175100.798085:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145244160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175100.798114:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175100.798125:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2fc380 x1872931145244160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175100.798135:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145244160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175100.798142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175100.798144:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175100.798147:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145244160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175100.798152:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145244288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175100.798166:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175100.798174:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2fd180 x1872931145244288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175100.798183:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145244288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175100.798207:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175100.798210:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175100.798213:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145244288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175100.798218:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145244416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175100.798235:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175100.798244:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175100/real 1786175100]  req@ffff89d9ba2fce00 x1872931145244416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175100.798255:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145244416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175100.798264:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175100.798267:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175100.798270:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145244416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175101.309026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175101.309126:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175101.821023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175102.333044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175102.333161:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175102.845025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175103.357096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175103.357139:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175103.869058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175104.380982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175104.381094:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175104.893044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175105.405084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175105.405244:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175105.917039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175105.917042:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175105.917056:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175105.917063:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917089:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00080000:1.0:1786175105.917106:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175105.917119:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175105.917180:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145244544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175105.917232:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175105.917240:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175105.917244:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917252:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00080000:1.0:1786175105.917261:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175105.917271:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175105.917288:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175105.917317:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145244544:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175105.917321:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145244672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175105.917349:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175105.917353:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175105.917356:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917362:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00080000:1.0:1786175105.917367:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175105.917373:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175105.917380:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175105.917398:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145244800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175105.917411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175105.917416:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175105.917418:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917421:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00080000:1.0:1786175105.917426:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175105.917430:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175105.917435:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175105.917449:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175105.917452:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145244928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175105.917469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175105.917474:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175105.917477:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917483:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00080000:1.0:1786175105.917492:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175105.917496:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175105.917501:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175105.917516:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145245056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175105.917528:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175105.917534:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786175105.917536:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2fe680 x1872931145244544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175105.917537:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917548:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00080000:1.0:1786175105.917557:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175105.917588:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175105.917590:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145244544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175105.917599:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786175105.917618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175105.917627:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145245184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175105.917629:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175105.917645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145244544:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175105.917662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175105.917669:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175105.917672:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917678:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00080000:1.0:1786175105.917685:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175105.917691:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145244672:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175105.917693:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175105.917710:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175105.917729:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145245312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175105.917743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175105.917753:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175105.917755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175105.917792:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917802:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00080000:1.0:1786175105.917811:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175105.917818:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175105.917827:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175105.917829:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2ff800 x1872931145244672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175105.917851:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145245440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175105.917858:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145244672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175105.917892:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175105.917896:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175105.917944:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175105.917949:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786175105.917957:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145244672:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175105.917958:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175105.917974:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8840
00000100:00100000:3.0:1786175105.917981:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145244800:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175105.917984:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175105.917999:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175105.918007:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175105.918025:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145245568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175105.918032:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175105.918057:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2fdc00 x1872931145244800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175105.918077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145244800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175105.918090:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175105.918104:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175105.918109:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145244800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175105.918117:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145244928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175105.918139:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175105.918152:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2fed80 x1872931145244928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175105.918167:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145244928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175105.918176:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175105.918180:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175105.918184:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145244928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175105.918191:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145245056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175105.918220:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175105.918231:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2ff480 x1872931145245056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175105.918245:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145245056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175105.918255:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175105.918258:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175105.918262:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145245056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175105.918268:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145245184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175105.918298:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175105.918309:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2fd880 x1872931145245184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175105.918323:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145245184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175105.918333:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175105.918336:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175105.918340:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145245184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175105.918367:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145245312:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175105.918392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175105.918404:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2fc700 x1872931145245312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175105.918419:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145245312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175105.918429:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175105.918432:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175105.918436:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145245312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175105.918443:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145245440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175105.918461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175105.918472:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2fe680 x1872931145245440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175105.918486:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145245440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175105.918496:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175105.918499:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175105.918503:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145245440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175105.918509:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145245568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175105.918527:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175105.918537:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175105/real 1786175105]  req@ffff89d9ba2fce00 x1872931145245568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175105.918551:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145245568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175105.918562:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175105.918566:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175105.918569:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145245568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175106.429056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175106.429150:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175106.941005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175107.453113:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175107.453153:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175107.965009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175108.477084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175108.477210:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175108.989094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175109.500980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175109.501052:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175110.012978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175110.525029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175110.525087:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175111.036994:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175111.037002:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175111.037006:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175111.037017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175111.037018:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00080000:1.0:1786175111.037032:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175111.037041:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175111.037078:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145245696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175111.037099:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175111.037101:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175111.037103:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175111.037106:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00080000:1.0:1786175111.037109:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175111.037112:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175111.037121:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175111.037132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145245696:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175111.037134:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145245824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175111.037164:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175111.037168:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175111.037170:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175111.037174:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00080000:1.0:1786175111.037178:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175111.037182:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175111.037187:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175111.037201:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145245952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175111.037217:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175111.037221:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175111.037222:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175111.037226:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00080000:1.0:1786175111.037229:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175111.037249:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175111.037257:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786175111.037260:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175111.037274:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145246080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175111.037287:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175111.037292:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175111.037296:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175111.037302:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00100000:3.0:1786175111.037307:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2fd180 x1872931145245696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175111.037311:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175111.037326:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175111.037335:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145245696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175111.037336:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175111.037353:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175111.037362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175111.037364:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145246208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175111.037369:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145245696:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175111.037387:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175111.037391:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175111.037393:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175111.037399:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00100000:3.0:1786175111.037404:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145245824:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175111.037406:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175111.037418:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175111.037424:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175111.037440:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175111.037442:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145246336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175111.037456:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175111.037458:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2fc380 x1872931145245824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175111.037462:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175111.037467:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175111.037480:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00080000:1.0:1786175111.037486:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175111.037491:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145245824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175111.037496:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175111.037519:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786175111.037522:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175111.037526:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175111.037530:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145246464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175111.037532:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145245824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175111.037544:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145245952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175111.037551:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175111.037555:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175111.037558:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175111.037563:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175111.037566:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00100000:3.0:1786175111.037583:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2fdf80 x1872931145245952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175111.037584:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175111.037594:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175111.037600:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145245952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175111.037602:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175111.037615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175111.037618:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145246592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175111.037623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175111.037632:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145245952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175111.037644:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175111.037647:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145246080:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175111.037649:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175111.037651:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175111.037663:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8845
00000100:00080000:1.0:1786175111.037666:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175111.037669:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175111.037675:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175111.037686:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175111.037687:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145246720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175111.037700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2ffb80 x1872931145246080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175111.037710:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145246080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175111.037740:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175111.037742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175111.037745:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145246080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175111.037750:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145246208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175111.037766:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175111.037773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2fe300 x1872931145246208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175111.037781:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145246208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175111.037786:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175111.037788:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175111.037789:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145246208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175111.037804:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145246336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175111.037814:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175111.037820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2ff100 x1872931145246336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175111.037828:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145246336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175111.037833:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175111.037835:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175111.037836:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145246336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175111.037840:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145246464:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175111.037850:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175111.037856:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2fea00 x1872931145246464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175111.037863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145246464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175111.037868:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175111.037869:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175111.037871:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145246464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175111.037874:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145246592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175111.037884:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175111.037889:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2fd500 x1872931145246592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175111.037915:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145246592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175111.037920:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175111.037923:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175111.037925:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145246592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175111.037929:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145246720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175111.037941:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175111.037947:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175111/real 1786175111]  req@ffff89d9ba2fd180 x1872931145246720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175111.037955:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145246720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175136 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175111.037961:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175111.037963:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175111.037965:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145246720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175111.549022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175111.549089:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175112.061032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175112.573010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175112.573049:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175113.085124:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175113.596980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175113.597052:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175114.108967:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175114.620970:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175114.621034:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175115.132982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175115.645061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175115.645222:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175116.156967:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175116.156980:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.156986:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175116.156991:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175116.157011:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00080000:1.0:1786175116.157022:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175116.157030:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175116.157065:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145246848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175116.157090:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.157094:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175116.157098:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175116.157103:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00080000:1.0:1786175116.157108:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175116.157114:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175116.157120:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145246848:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786175116.157128:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175116.157159:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145246976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175116.157169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.157171:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175116.157173:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175116.157176:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00080000:1.0:1786175116.157179:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175116.157182:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175116.157186:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175116.157197:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145247104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175116.157204:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175116.157211:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.157214:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175116.157215:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175116.157219:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00080000:1.0:1786175116.157222:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175116.157224:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175116.157228:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175116.157236:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145247232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175116.157243:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.157246:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175116.157247:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175116.157250:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00080000:1.0:1786175116.157252:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175116.157256:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2fce00 x1872931145246848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175116.157257:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175116.157264:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175116.157274:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145247360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175116.157282:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.157286:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786175116.157286:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145246848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175116.157290:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175116.157299:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00080000:1.0:1786175116.157304:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175116.157304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175116.157309:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175116.157313:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786175116.157315:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175116.157318:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145246848:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175116.157327:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145247488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175116.157334:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.157336:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175116.157338:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175116.157344:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00100000:3.0:1786175116.157344:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145246976:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175116.157347:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175116.157351:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175116.157355:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175116.157364:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145247616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175116.157372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.157374:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175116.157378:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175116.157380:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175116.157383:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00080000:1.0:1786175116.157388:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175116.157391:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175116.157395:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175116.157407:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145247744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175116.157407:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2fe680 x1872931145246976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175116.157438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175116.157441:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175116.157444:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175116.157445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145246976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175116.157449:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8850
00000100:00080000:1.0:1786175116.157455:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175116.157462:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175116.157462:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786175116.157467:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175116.157469:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175116.157475:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145246976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175116.157480:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145247872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175116.157484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145247104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175116.157512:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175116.157522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2fc700 x1872931145247104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175116.157531:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145247104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175116.157536:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175116.157538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175116.157540:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145247104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175116.157544:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145247232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175116.157556:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175116.157573:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2fd880 x1872931145247232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175116.157581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145247232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175116.157586:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175116.157588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175116.157590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145247232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175116.157594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145247360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175116.157604:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175116.157610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2ff480 x1872931145247360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175116.157617:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145247360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175116.157622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175116.157624:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175116.157626:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145247360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175116.157629:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145247488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175116.157639:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175116.157645:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2fed80 x1872931145247488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175116.157651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145247488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175116.157657:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175116.157658:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175116.157660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145247488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175116.157694:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145247616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175116.157735:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175116.157747:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2fdc00 x1872931145247616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175116.157759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145247616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175116.157769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175116.157772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175116.157776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145247616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175116.157783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145247744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175116.157801:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175116.157810:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2ff800 x1872931145247744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175116.157818:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145247744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175116.157823:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175116.157826:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175116.157828:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145247744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175116.157831:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145247872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175116.157841:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175116.157847:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175116/real 1786175116]  req@ffff89d9ba2fce00 x1872931145247872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175116.157854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145247872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175116.157860:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175116.157862:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175116.157864:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145247872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175116.669037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175116.669094:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175117.181049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175117.693071:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175117.693181:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175118.205119:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175118.716998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175118.717108:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175119.229122:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175119.741063:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175119.741214:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175120.253055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175120.765027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175120.765227:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175121.277026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.277041:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175121.277048:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175121.277061:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8855
00000100:00080000:1.0:1786175121.277075:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175121.277082:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175121.277087:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175121.277143:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145248000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175121.277195:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.277202:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175121.277206:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175121.277214:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8855
00000100:00080000:1.0:1786175121.277221:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175121.277234:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175121.277249:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175121.277278:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145248000:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175121.277280:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145248128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175121.277319:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.277325:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175121.277329:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175121.277342:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8855
00000100:00080000:1.0:1786175121.277348:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175121.277354:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175121.277364:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175121.277386:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145248256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175121.277413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.277420:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175121.277423:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175121.277429:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8855
00000100:00080000:1.0:1786175121.277436:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175121.277442:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175121.277450:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175121.277471:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175121.277494:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145248384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175121.277510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.277516:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175121.277520:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175121.277528:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8855
00000100:00080000:1.0:1786175121.277536:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175121.277537:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2fd180 x1872931145248000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175121.277554:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175121.277572:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175121.277609:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145248512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175121.277646:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145248000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175121.277657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.277676:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175121.277683:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175121.277693:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.277706:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175121.277715:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8855
00000100:00100000:2.0:1786175121.277724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145248000:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175121.277728:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175121.277746:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175121.277755:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175121.277776:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145248640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175121.277788:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145248128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175121.277802:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.277811:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175121.277816:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175121.277828:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8855
00000100:00080000:1.0:1786175121.277837:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175121.277845:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175121.277854:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175121.277867:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175121.277877:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2fd500 x1872931145248128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175121.277929:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145248768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175121.277946:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.277952:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175121.277957:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175121.277968:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8855
00000100:00080000:1.0:1786175121.277975:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175121.277978:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145248128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175121.277990:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175121.278007:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175121.278012:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.278020:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175121.278027:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145248128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175121.278039:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145248896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175121.278047:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145248256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175121.278082:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175121.278089:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175121.278095:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175121.278105:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8855
00000800:00000100:2.0:1786175121.278115:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175121.278117:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175121.278129:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175121.278138:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175121.278150:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2fea00 x1872931145248256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175121.278164:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145249024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175121.278215:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145248256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175121.278237:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.278245:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175121.278253:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145248256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175121.278268:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145248384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175121.278313:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175121.278331:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2ff100 x1872931145248384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175121.278347:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145248384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175121.278358:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.278362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175121.278367:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145248384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175121.278376:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145248512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175121.278416:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175121.278427:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2fe300 x1872931145248512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175121.278440:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145248512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175121.278449:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.278452:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175121.278455:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145248512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175121.278504:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145248640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175121.278529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175121.278546:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2ffb80 x1872931145248640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175121.278570:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145248640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175121.278602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.278608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175121.278614:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145248640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175121.278650:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145248768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175121.278695:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175121.278715:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2fdf80 x1872931145248768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175121.278737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145248768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175121.278752:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.278758:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175121.278764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145248768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175121.278776:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145248896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175121.278808:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175121.278823:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2fc380 x1872931145248896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175121.278836:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145248896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175121.278846:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.278850:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175121.278854:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145248896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175121.278861:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145249024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175121.278879:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175121.278888:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175121/real 1786175121]  req@ffff89d9ba2fd180 x1872931145249024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175121.278949:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145249024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175121.278966:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175121.278972:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175121.278978:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145249024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175121.789033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175121.789195:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175122.301089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175122.813077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175122.813170:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175123.325086:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175123.837036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175123.837110:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175124.349115:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175124.861019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175124.861281:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175125.373167:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175125.885010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175125.885082:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175126.397044:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175126.397060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175126.397061:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175126.397086:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175126.397102:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00080000:1.0:1786175126.397116:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175126.397128:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175126.397177:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145249152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175126.397235:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175126.397241:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175126.397243:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175126.397249:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00080000:1.0:1786175126.397254:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175126.397265:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175126.397277:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175126.397296:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145249280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175126.397312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175126.397318:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175126.397320:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175126.397330:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00100000:2.0:1786175126.397332:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145249152:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175126.397336:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175126.397348:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175126.397356:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175126.397374:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145249408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175126.397413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175126.397419:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175126.397424:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175126.397431:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00080000:1.0:1786175126.397439:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175126.397446:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175126.397470:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175126.397486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145249536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175126.397500:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175126.397506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786175126.397511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145249280:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175126.397513:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175126.397530:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00080000:1.0:1786175126.397538:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175126.397545:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175126.397554:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175126.397594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145249408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175126.397600:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145249664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175126.397630:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175126.397634:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175126.397638:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175126.397645:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00100000:2.0:1786175126.397649:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145249536:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175126.397654:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175126.397665:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175126.397674:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175126.397683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145249664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175126.397698:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145249792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175126.397730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175126.397735:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175126.397739:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175126.397742:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145249792:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175126.397751:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00080000:1.0:1786175126.397759:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175126.397766:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175126.397776:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175126.397795:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145249920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175126.397822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175126.397827:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175126.397830:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175126.397837:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00080000:1.0:1786175126.397842:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175126.397848:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175126.397857:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175126.397870:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145249920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175126.397879:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145250048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175126.397933:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175126.397939:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175126.397943:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175126.397952:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8860
00000100:00080000:1.0:1786175126.397961:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175126.397969:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145250048:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175126.397971:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175126.397986:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175126.398012:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145250176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175126.398067:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145250176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175126.909082:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175126.909190:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175127.421115:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175127.933038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175127.933213:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175128.445124:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175128.957022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175128.957128:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175129.469078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786175129.469501:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786175129.469668:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786175129.469700:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175129.469949:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2fce00 x1872931145249152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175129.470037:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145249152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175129.470075:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175129.470085:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175129.470093:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145249152:192.168.202.130@tcp:250:kworker.0
00000800:00000100:0.0:1786175129.472130:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786175129.472196:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175129.472225:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786175129.472235:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2fd180 x1872931145250176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786175129.472246:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175129.472266:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786175129.472292:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145250176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786175129.472306:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786175129.472332:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:0.0:1786175129.472334:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786175129.472349:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000800:00000100:0.0:1786175129.472360:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786175129.472368:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145250176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175129.472383:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2fe680 x1872931145250048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175129.472413:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145250048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175129.472423:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175129.472428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175129.472432:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145250048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175129.472441:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2fc700 x1872931145249920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175129.472456:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145249920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175129.472465:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175129.472469:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175129.472489:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145249920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175129.472498:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2fd880 x1872931145249792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175129.472512:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145249792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175129.472521:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175129.472525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175129.472559:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145249792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175129.472582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2ff480 x1872931145249664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175129.472599:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145249664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175129.472610:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175129.472614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175129.472618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145249664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175129.472625:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2fdc00 x1872931145249408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175129.472638:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145249408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175129.472648:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175129.472652:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175129.472656:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145249408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175129.472663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2fed80 x1872931145249536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175129.472676:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145249536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175129.472685:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175129.472688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175129.472692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145249536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175129.472699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175126/real 1786175129]  req@ffff89d9ba2ff800 x1872931145249280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175129.472713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145249280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175129.472723:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175129.472726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175129.472730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145249280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175129.981050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175129.981157:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175130.493039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175131.005020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175131.005171:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175131.517043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175131.517105:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175131.517112:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175131.517122:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517132:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00080000:1.0:1786175131.517141:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517149:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175131.517184:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145250304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175131.517207:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175131.517210:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175131.517212:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517215:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00080000:1.0:1786175131.517218:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517221:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175131.517231:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175131.517242:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145250432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175131.517250:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145250304:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175131.517256:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175131.517261:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175131.517263:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517268:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00080000:1.0:1786175131.517270:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517273:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175131.517277:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175131.517287:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145250560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175131.517295:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175131.517298:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175131.517300:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517304:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00080000:1.0:1786175131.517309:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517314:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175131.517321:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175131.517332:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175131.517338:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145250688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175131.517353:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175131.517358:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175131.517361:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517366:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00080000:1.0:1786175131.517371:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517375:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175131.517381:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175131.517396:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2fc380 x1872931145250304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175131.517398:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145250816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175131.517419:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175131.517427:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175131.517430:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517435:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00080000:1.0:1786175131.517439:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517443:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175131.517449:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175131.517460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145250304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175131.517466:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145250944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175131.517493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175131.517494:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175131.517503:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175131.517507:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175131.517509:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517538:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00080000:1.0:1786175131.517543:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517546:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175131.517553:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175131.517555:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145250304:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175131.517573:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145251072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175131.517587:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175131.517591:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1786175131.517596:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145250432:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175131.517597:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517610:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00080000:1.0:1786175131.517616:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517622:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175131.517629:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175131.517643:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175131.517649:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145251200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175131.517665:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175131.517666:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2fdf80 x1872931145250432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175131.517677:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175131.517684:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175131.517696:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8865
00000100:00100000:3.0:1786175131.517703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145250432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175131.517704:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175131.517716:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175131.517729:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175131.517729:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175131.517740:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175131.517748:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145250432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175131.517754:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145251328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175131.517763:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145250560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175131.517806:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175131.517822:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2ffb80 x1872931145250560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175131.517837:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145250560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175131.517846:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175131.517851:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175131.517855:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145250560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175131.517862:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145250688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175131.517886:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175131.517928:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2fe300 x1872931145250688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175131.517943:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145250688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175131.517952:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175131.517956:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175131.517960:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145250688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175131.517968:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145250816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175131.517993:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175131.518008:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2ff100 x1872931145250816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175131.518181:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145250816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175131.518193:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175131.518198:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175131.518202:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145250816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175131.518211:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145250944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175131.518246:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175131.518265:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2fea00 x1872931145250944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175131.518280:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145250944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175131.518290:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175131.518295:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175131.518300:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145250944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175131.518307:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145251072:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175131.518335:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175131.518352:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2fd500 x1872931145251072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175131.518367:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145251072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175131.518378:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175131.518383:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175131.518387:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145251072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175131.518447:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145251200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175131.518478:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175131.518501:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2fc380 x1872931145251200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175131.518536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145251200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175131.518548:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175131.518553:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175131.518557:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145251200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175131.518565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145251328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175131.518594:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175131.518610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175131/real 1786175131]  req@ffff89d9ba2ff800 x1872931145251328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175131.518625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145251328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175131.518637:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175131.518641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175131.518645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145251328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175132.029006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175132.029017:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175132.541014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175133.053071:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175133.053189:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175133.565078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175134.077079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175134.077155:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175134.589091:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175135.101031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175135.101117:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175135.613024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175136.125066:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175136.125079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175136.637019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175136.637206:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175136.637218:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175136.637225:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175136.637240:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00080000:0.0:1786175136.637257:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175136.637268:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175136.637330:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145251456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175136.637370:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175136.637375:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175136.637377:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175136.637381:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00080000:0.0:1786175136.637385:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175136.637389:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175136.637403:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175136.637419:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145251584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175136.637433:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175136.637440:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145251456:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175136.637441:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175136.637451:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175136.637495:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00080000:0.0:1786175136.637502:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175136.637516:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175136.637525:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175136.637543:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145251712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175136.637555:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175136.637559:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175136.637562:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175136.637566:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00080000:0.0:1786175136.637572:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175136.637582:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175136.637588:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175136.637597:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175136.637619:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145251840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175136.637630:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175136.637635:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175136.637639:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175136.637647:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00100000:3.0:1786175136.637653:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f2680 x1872931145251456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175136.637658:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175136.637679:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175136.637691:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145251456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175136.637693:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175136.637719:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175136.637725:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175136.637734:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145251968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175136.637735:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145251456:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175136.637774:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175136.637779:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175136.637783:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175136.637794:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00100000:3.0:1786175136.637795:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145251584:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175136.637805:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175136.637816:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175136.637826:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175136.637842:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175136.637847:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145252096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175136.637866:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f1500 x1872931145251584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175136.637951:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145251584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175136.637996:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175136.638005:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175136.638016:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175136.638018:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145251584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175136.638039:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145251712:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175136.638041:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175136.638052:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175136.638066:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00080000:0.0:1786175136.638076:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175136.638083:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175136.638093:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175136.638094:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175136.638126:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145252224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175136.638143:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f0700 x1872931145251712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175136.638147:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175136.638194:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175136.638197:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175136.638205:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145251712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175136.638221:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00080000:3.0:1786175136.638234:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175136.638238:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175136.638245:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175136.638267:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145251712:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175136.638272:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175136.638294:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175136.638295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145251840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175136.638337:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145252352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175136.638353:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175136.638360:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175136.638371:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175136.638377:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175136.638387:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8870
00000100:00100000:3.0:1786175136.638396:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f3b80 x1872931145251840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175136.638399:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175136.638418:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175136.638445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145251840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175136.638450:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175136.638496:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175136.638498:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145252480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175136.638512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175136.638536:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145251840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175136.638563:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145251968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175136.638596:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175136.638610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f3480 x1872931145251968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175136.638623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145251968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175136.638631:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175136.638635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175136.638638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145251968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175136.638661:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145252096:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175136.638679:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175136.638690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f2d80 x1872931145252096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175136.638702:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145252096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175136.638711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175136.638714:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175136.638717:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145252096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175136.638723:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145252224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175136.638739:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175136.638749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f2a00 x1872931145252224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175136.638762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145252224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175136.638770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175136.638773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175136.638776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145252224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175136.638782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145252352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175136.638797:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175136.638807:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f0e00 x1872931145252352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175136.638818:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145252352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175136.638839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175136.638843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175136.638847:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145252352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175136.638859:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145252480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175136.638878:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175136.638888:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175136/real 1786175136]  req@ffff89d9870f1880 x1872931145252480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175136.638934:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145252480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175136.638950:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175136.638956:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175136.638961:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145252480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175137.149058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175137.149150:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175137.660977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175138.173023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175138.173208:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175138.685027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175139.197006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175139.197045:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175139.708956:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175140.221017:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175140.221018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175140.732963:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175141.244979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175141.245016:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175141.756995:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175141.757004:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175141.757009:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175141.757019:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00100000:2.0:1786175141.757025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175141.757028:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175141.757038:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175141.757069:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145252608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175141.757093:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175141.757096:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175141.757098:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175141.757101:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00080000:0.0:1786175141.757104:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175141.757107:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175141.757115:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175141.757128:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145252608:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175141.757129:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145252736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175141.757162:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175141.757169:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175141.757172:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175141.757179:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00080000:0.0:1786175141.757185:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175141.757193:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175141.757193:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175141.757202:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175141.757216:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145252864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175141.757225:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175141.757228:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175141.757230:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175141.757236:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00100000:3.0:1786175141.757237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f1180 x1872931145252608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175141.757239:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175141.757249:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175141.757258:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175141.757262:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145252608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175141.757274:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175141.757280:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145252992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175141.757280:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175141.757287:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145252608:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175141.757305:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175141.757309:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786175141.757313:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145252736:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175141.757315:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175141.757322:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00080000:0.0:1786175141.757327:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175141.757331:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175141.757337:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175141.757338:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175141.757350:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f0a80 x1872931145252736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175141.757355:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145253120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175141.757372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145252736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175141.757375:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175141.757384:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175141.757388:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175141.757393:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175141.757395:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00080000:3.0:1786175141.757400:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175141.757401:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175141.757407:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145252736:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175141.757408:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175141.757435:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175141.757436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145252864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175141.757454:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145253248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175141.757464:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175141.757464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175141.757470:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175141.757472:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175141.757477:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00100000:3.0:1786175141.757481:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f3100 x1872931145252864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175141.757483:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175141.757492:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175141.757498:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175141.757499:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145252864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175141.757508:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175141.757510:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145253376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175141.757516:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175141.757523:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145252864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175141.757532:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175141.757536:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145252992:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175141.757538:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175141.757544:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175141.757549:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00080000:0.0:1786175141.757553:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175141.757556:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175141.757561:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175141.757564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175141.757576:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145253504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175141.757578:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f1880 x1872931145252992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175141.757593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145252992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175141.757612:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175141.757613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175141.757622:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175141.757622:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175141.757627:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175141.757630:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145252992:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175141.757635:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8875
00000100:00080000:0.0:1786175141.757640:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175141.757644:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175141.757648:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175141.757652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145253120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175141.757659:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145253632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175141.757674:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175141.757685:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f0e00 x1872931145253120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175141.757694:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145253120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175141.757700:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175141.757703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175141.757705:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145253120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175141.757709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145253248:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175141.757720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175141.757726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f2a00 x1872931145253248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175141.757735:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145253248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175141.757740:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175141.757742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175141.757744:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145253248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175141.757748:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145253376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175141.757758:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175141.757765:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f2d80 x1872931145253376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175141.757773:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145253376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175141.757778:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175141.757780:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175141.757782:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145253376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175141.757786:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145253504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175141.757796:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175141.757802:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f3480 x1872931145253504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175141.757810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145253504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175141.757815:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175141.757817:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175141.757819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145253504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175141.757829:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145253632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175141.757840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175141.757846:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175141/real 1786175141]  req@ffff89d9870f3b80 x1872931145253632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175141.757855:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145253632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175141.757861:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175141.757863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175141.757865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145253632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175142.269039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175142.269113:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175142.780950:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175143.292984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175143.293072:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175143.805002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175144.316987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175144.317074:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175144.828962:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175145.341022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175145.341057:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175145.853023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175146.364977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175146.365016:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175146.876990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175146.877016:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175146.877029:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175146.877034:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175146.877046:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877066:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175146.877075:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175146.877111:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145253760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175146.877135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175146.877138:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175146.877140:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175146.877142:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877146:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175146.877150:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175146.877160:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175146.877169:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145253760:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175146.877187:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145253888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175146.877201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175146.877204:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175146.877206:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175146.877209:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877213:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175146.877216:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175146.877221:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175146.877229:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175146.877234:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145254016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175146.877244:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175146.877247:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175146.877248:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175146.877252:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877256:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175146.877261:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175146.877267:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f0700 x1872931145253760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175146.877268:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175146.877290:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145254144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175146.877290:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145253760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175146.877323:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175146.877325:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175146.877329:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175146.877331:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175146.877334:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175146.877335:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145253760:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175146.877341:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877344:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175146.877348:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175146.877351:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175146.877360:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145253888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175146.877364:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145254272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175146.877392:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175146.877395:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175146.877397:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175146.877400:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877404:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175146.877408:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175146.877413:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175146.877414:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175146.877425:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f1500 x1872931145253888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175146.877429:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145254400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175146.877450:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145253888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175146.877458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175146.877465:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175146.877467:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175146.877468:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175146.877476:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175146.877477:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877483:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175146.877485:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145253888:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175146.877489:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175146.877494:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175146.877495:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145254016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175146.877504:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145254528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175146.877512:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175146.877516:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175146.877518:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175146.877520:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175146.877525:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877528:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175146.877529:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f2680 x1872931145254016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175146.877534:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175146.877542:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175146.877547:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145254016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175146.877556:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175146.877561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145254656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175146.877562:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175146.877567:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145254016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175146.877578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145254144:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175146.877588:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175146.877592:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175146.877595:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175146.877600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175146.877604:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8881
00000100:00080000:0.0:1786175146.877609:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175146.877610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f3b80 x1872931145254144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175146.877616:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175146.877626:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175146.877630:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145254144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175146.877638:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175146.877641:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145254784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175146.877644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175146.877651:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145254144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175146.877674:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145254272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175146.877688:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175146.877694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f3480 x1872931145254272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175146.877701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145254272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175146.877706:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175146.877707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175146.877709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145254272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175146.877713:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145254400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175146.877723:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175146.877729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f2d80 x1872931145254400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175146.877736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145254400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175146.877741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175146.877743:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175146.877744:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145254400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175146.877748:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145254528:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175146.877757:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175146.877763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f2a00 x1872931145254528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175146.877770:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145254528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175146.877775:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175146.877777:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175146.877778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145254528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175146.877782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145254656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175146.877791:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175146.877797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f0e00 x1872931145254656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175146.877804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145254656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175146.877809:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175146.877811:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175146.877813:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145254656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175146.877816:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145254784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175146.877825:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175146.877830:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175146/real 1786175146]  req@ffff89d9870f1880 x1872931145254784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175146.877837:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145254784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175146.877843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175146.877845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175146.877847:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145254784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175147.389000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175147.389081:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175147.900981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175148.413006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175148.413049:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175148.925000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175149.436979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175149.437028:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175149.949050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175150.460972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175150.461029:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175150.972988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175151.485028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175151.485097:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175151.996980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175151.997002:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175151.997010:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175151.997015:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175151.997025:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:1.0:1786175151.997035:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175151.997043:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175151.997079:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145254912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175151.997107:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175151.997112:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175151.997114:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175151.997120:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:1.0:1786175151.997125:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175151.997130:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997137:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145254912:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786175151.997140:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175151.997158:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145255040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175151.997170:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175151.997174:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175151.997176:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175151.997182:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:1.0:1786175151.997187:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175151.997191:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175151.997195:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786175151.997199:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175151.997216:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145255168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175151.997227:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175151.997228:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2fed80 x1872931145254912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175151.997241:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175151.997250:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:1.0:1786175151.997256:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175151.997261:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145254912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997262:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175151.997271:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175151.997283:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175151.997288:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145255296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175151.997291:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175151.997301:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145254912:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175151.997310:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175151.997315:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175151.997330:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175151.997335:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:1.0:1786175151.997340:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175151.997341:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145255040:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175151.997349:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175151.997356:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175151.997368:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175151.997372:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145255424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175151.997381:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2fdc00 x1872931145255040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997388:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175151.997397:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175151.997402:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175151.997407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145255040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997410:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:1.0:1786175151.997419:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175151.997420:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175151.997426:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175151.997426:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175151.997433:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145255040:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175151.997437:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175151.997440:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145255168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175151.997456:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145255552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175151.997460:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997472:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2ff480 x1872931145255168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997473:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175151.997483:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175151.997488:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175151.997492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145255168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997496:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:1.0:1786175151.997505:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175151.997505:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175151.997515:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175151.997516:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145255168:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175151.997527:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175151.997528:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145255296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175151.997549:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145255680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175151.997550:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997560:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2fd880 x1872931145255296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997566:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175151.997573:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145255296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997574:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175151.997578:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175151.997589:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:3.0:1786175151.997593:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175151.997596:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175151.997597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175151.997603:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145255296:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175151.997607:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175151.997614:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175151.997619:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145255424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175151.997631:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145255808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175151.997637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997648:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2fc700 x1872931145255424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997650:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175151.997658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175151.997661:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175151.997666:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145255424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175151.997667:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8886
00000100:00080000:1.0:1786175151.997674:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175151.997679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175151.997680:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175151.997685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786175151.997688:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175151.997689:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145255424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175151.997698:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145255552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175151.997704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145255936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175151.997713:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997722:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2fe680 x1872931145255552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175151.997730:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145255552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175151.997736:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175151.997738:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175151.997740:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145255552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175151.997744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145255680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175151.997753:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997759:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2fd180 x1872931145255680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175151.997766:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145255680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175151.997770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175151.997772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175151.997774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145255680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175151.997782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145255808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175151.997792:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2fce00 x1872931145255808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175151.997805:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145255808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175151.997810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175151.997811:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175151.997813:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145255808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175151.997816:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145255936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175151.997826:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175151.997832:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175151/real 1786175151]  req@ffff89d9ba2fd880 x1872931145255936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175151.997839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145255936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175151.997844:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175151.997845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175151.997847:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145255936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175152.508976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175152.509031:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175153.020982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175153.533054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175153.533058:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175154.045009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175154.556998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175154.557055:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175155.068953:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175155.581010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175155.581098:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175156.092960:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175156.605003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175156.605051:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175157.116971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175157.117000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175157.117010:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175157.117016:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175157.117029:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117042:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175157.117051:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175157.117097:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145256064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175157.117129:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175157.117134:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175157.117136:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175157.117141:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117145:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175157.117151:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175157.117164:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175157.117168:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145256064:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175157.117183:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145256192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175157.117200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175157.117205:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175157.117207:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175157.117212:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117218:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175157.117223:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175157.117230:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175157.117241:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175157.117246:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145256320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175157.117262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175157.117267:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175157.117281:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175157.117288:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117292:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175157.117299:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2ff480 x1872931145256064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175157.117300:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175157.117313:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175157.117324:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145256064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175157.117332:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145256448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175157.117337:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175157.117351:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175157.117358:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175157.117363:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175157.117365:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175157.117370:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117373:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175157.117376:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175157.117382:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175157.117393:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145256576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175157.117407:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145256064:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175157.117414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175157.117420:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175157.117423:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175157.117430:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117436:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175157.117440:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175157.117445:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145256192:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175157.117447:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175157.117472:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145256704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175157.117480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175157.117501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175157.117502:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2fdc00 x1872931145256192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175157.117518:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175157.117524:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175157.117530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145256192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175157.117534:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117547:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175157.117549:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175157.117557:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175157.117563:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175157.117566:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145256192:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175157.117575:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175157.117583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145256320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175157.117598:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145256832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175157.117608:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175157.117623:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2fed80 x1872931145256320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175157.117624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175157.117641:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175157.117647:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175157.117661:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145256320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175157.117663:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117674:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175157.117676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175157.117682:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175157.117685:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175157.117689:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145256320:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175157.117698:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175157.117701:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145256448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175157.117724:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175157.117733:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145256960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175157.117736:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2ff800 x1872931145256448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175157.117789:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175157.117795:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145256448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175157.117796:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175157.117801:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175157.117811:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8891
00000100:00080000:1.0:1786175157.117819:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175157.117821:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175157.117828:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175157.117833:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786175157.117838:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175157.117842:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145256448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175157.117858:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145256576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175157.117859:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145257088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175157.117917:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175157.117933:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2fc380 x1872931145256576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175157.117943:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145256576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175157.117951:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175157.117955:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175157.117957:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145256576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175157.117974:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145256704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175157.117988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175157.117995:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2fd500 x1872931145256704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175157.118004:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145256704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175157.118010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175157.118014:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175157.118018:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145256704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175157.118026:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145256832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175157.118044:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175157.118061:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2fea00 x1872931145256832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175157.118069:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145256832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175157.118074:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175157.118076:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175157.118078:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145256832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175157.118081:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145256960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175157.118094:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175157.118106:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2ff100 x1872931145256960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175157.118114:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145256960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175157.118120:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175157.118123:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175157.118127:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145256960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175157.118135:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145257088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175157.118150:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175157.118169:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175157/real 1786175157]  req@ffff89d9ba2fe300 x1872931145257088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175157.118183:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145257088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175157.118191:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175157.118195:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175157.118198:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145257088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175157.629011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175157.629070:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175158.140984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175158.653026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175158.653102:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175159.164970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175159.676967:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175159.677053:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175160.188962:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175160.700969:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175160.701018:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175161.212977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175161.725021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175161.725046:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175162.236968:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175162.236989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175162.236996:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175162.237000:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175162.237010:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237019:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175162.237028:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175162.237061:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145257216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175162.237088:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175162.237091:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175162.237092:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175162.237095:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237097:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175162.237100:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175162.237108:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175162.237116:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145257344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175162.237125:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175162.237126:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145257216:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175162.237129:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175162.237132:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175162.237138:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237140:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175162.237142:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175162.237146:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175162.237155:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145257472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175162.237161:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175162.237164:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175162.237165:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175162.237168:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237172:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175162.237174:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175162.237177:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175162.237184:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145257600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175162.237189:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175162.237192:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175162.237196:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175162.237197:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175162.237202:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237205:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175162.237208:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175162.237211:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175162.237235:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145257728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175162.237241:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175162.237244:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175162.237245:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175162.237248:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237251:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175162.237254:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175162.237258:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175162.237260:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2ffb80 x1872931145257216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175162.237269:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145257856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175162.237296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175162.237299:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145257216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175162.237300:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175162.237303:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175162.237311:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237316:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175162.237317:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175162.237319:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175162.237324:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786175162.237324:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237329:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145257216:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175162.237335:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145257984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175162.237342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175162.237344:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175162.237346:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175162.237349:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237351:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175162.237354:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145257344:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175162.237356:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175162.237363:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175162.237372:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145258112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175162.237380:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175162.237384:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175162.237385:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175162.237389:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175162.237393:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8896
00000100:00080000:1.0:1786175162.237397:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175162.237400:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2fdf80 x1872931145257344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175162.237403:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175162.237410:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175162.237418:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145257344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175162.237422:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145258240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175162.237434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175162.237440:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237444:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145257344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175162.237449:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145257472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175162.237463:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175162.237470:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2fe300 x1872931145257472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175162.237478:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145257472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175162.237488:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175162.237490:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145257472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175162.237495:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145257600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175162.237506:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175162.237512:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2ff100 x1872931145257600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175162.237519:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145257600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175162.237524:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175162.237526:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237528:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145257600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175162.237531:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145257728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175162.237541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175162.237546:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2fea00 x1872931145257728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175162.237553:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145257728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175162.237558:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175162.237560:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237562:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145257728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175162.237565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145257856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175162.237575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175162.237580:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2fd500 x1872931145257856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175162.237587:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145257856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175162.237591:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175162.237593:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237595:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145257856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175162.237598:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145257984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175162.237608:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175162.237613:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2fc380 x1872931145257984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175162.237620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145257984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175162.237625:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175162.237627:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145257984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175162.237643:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145258112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175162.237657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175162.237668:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2ff800 x1872931145258112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175162.237681:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145258112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175162.237690:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175162.237694:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145258112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175162.237703:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145258240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175162.237720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175162.237728:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175162/real 1786175162]  req@ffff89d9ba2fed80 x1872931145258240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175162.237736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145258240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175162.237742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175162.237744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175162.237746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145258240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175162.749017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175162.749047:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175163.260973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175163.772972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175163.773168:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175164.285035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175164.797090:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175164.797116:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175165.309058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175165.821015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175165.821119:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175166.333055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175166.844982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175166.845081:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175167.357044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175167.357051:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.357063:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175167.357069:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175167.357082:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.357095:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175167.357106:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175167.357157:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145258368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175167.357224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.357229:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175167.357240:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175167.357247:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.357253:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175167.357260:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175167.357273:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175167.357299:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145258496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175167.357299:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145258368:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175167.357327:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.357332:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175167.357334:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175167.357340:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.357348:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175167.357355:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175167.357366:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175167.357390:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145258624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175167.357409:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175167.357421:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.357430:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175167.357435:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175167.357446:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.357455:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175167.357463:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175167.357472:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175167.357484:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2fdc00 x1872931145258368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175167.357493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145258752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175167.357547:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.357552:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175167.357555:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175167.357563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145258368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175167.357568:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.357579:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175167.357596:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175167.357604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175167.357605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175167.357614:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145258368:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786175167.357618:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175167.357639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145258880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175167.357654:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145258496:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175167.357655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.357670:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175167.357673:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175167.357680:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.357686:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175167.357691:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175167.357698:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175167.357709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175167.357718:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145259008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175167.357732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2ff480 x1872931145258496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175167.357735:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.357752:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:3.0:1786175167.357756:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145258496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175167.357758:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175167.357773:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.357785:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175167.357790:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175167.357794:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175167.357802:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786175167.357807:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175167.357811:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145258496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175167.357825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145258624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175167.357830:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145259136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175167.357848:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.357852:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175167.357855:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175167.357860:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175167.357868:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.357877:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175167.357884:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2fd880 x1872931145258624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175167.357887:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175167.357939:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175167.357947:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145258624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175167.357961:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175167.357964:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145259264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175167.357971:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175167.357986:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145258624:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175167.357995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175167.358001:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786175167.358004:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145258752:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175167.358007:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175167.358023:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8901
00000100:00080000:1.0:1786175167.358030:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175167.358036:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175167.358043:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175167.358050:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175167.358063:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145259392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175167.358072:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2fce00 x1872931145258752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175167.358099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145258752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175167.358110:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175167.358115:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175167.358121:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145258752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175167.358149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145258880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175167.358200:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175167.358218:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2fd180 x1872931145258880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175167.358233:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145258880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175167.358244:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175167.358250:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175167.358257:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145258880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175167.358269:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145259008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175167.358307:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175167.358330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2fe680 x1872931145259008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175167.358355:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145259008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175167.358369:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175167.358373:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175167.358377:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145259008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175167.358385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145259136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175167.358412:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175167.358432:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2fc700 x1872931145259136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175167.358456:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145259136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175167.358472:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175167.358478:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175167.358486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145259136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175167.358498:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145259264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175167.358529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175167.358545:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2fdc00 x1872931145259264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175167.358559:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145259264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175167.358569:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175167.358572:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175167.358576:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145259264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175167.358583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145259392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175167.358601:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175167.358612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175167/real 1786175167]  req@ffff89d9ba2fed80 x1872931145259392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175167.358626:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145259392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175167.358636:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175167.358639:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175167.358643:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145259392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175167.869046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175167.869227:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175168.381031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175168.893031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175168.893142:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175169.405044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175169.917038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175169.917086:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175170.429003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175170.941019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175170.941123:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175171.453110:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175171.965028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175171.965209:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175172.477098:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175172.477174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175172.477183:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175172.477189:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175172.477202:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:2.0:1786175172.477215:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175172.477224:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175172.477274:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145259520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175172.477312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175172.477317:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175172.477320:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175172.477324:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:2.0:1786175172.477329:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175172.477333:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175172.477345:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175172.477362:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145259648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175172.477375:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175172.477380:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175172.477383:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175172.477389:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:2.0:1786175172.477396:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175172.477405:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175172.477417:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175172.477423:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145259520:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175172.477448:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145259776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175172.477490:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175172.477497:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175172.477502:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175172.477508:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:2.0:1786175172.477538:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175172.477544:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175172.477553:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175172.477561:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175172.477579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145259904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175172.477596:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175172.477601:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175172.477603:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175172.477610:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:2.0:1786175172.477618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175172.477626:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175172.477637:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175172.477647:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87ca80 x1872931145259520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175172.477687:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145259520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175172.477690:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145260032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175172.477773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175172.477777:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175172.477787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175172.477789:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175172.477796:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175172.477803:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145259520:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175172.477814:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:2.0:1786175172.477827:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175172.477830:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145259648:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175172.477846:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175172.477860:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175172.477885:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175172.477886:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145260160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175172.477956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175172.477965:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:3.0:1786175172.477967:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87ed80 x1872931145259648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175172.477969:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175172.477980:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:2.0:1786175172.477992:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175172.478008:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175172.478018:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175172.478039:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145260288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175172.478052:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145259648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175172.478059:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175172.478074:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175172.478083:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175172.478104:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:3.0:1786175172.478109:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175172.478111:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175172.478149:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175172.478159:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175172.478169:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145259648:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175172.478176:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175172.478216:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145260416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175172.478247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175172.478251:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145259776:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175172.478258:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175172.478270:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175172.478277:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8906
00000100:00080000:2.0:1786175172.478285:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175172.478290:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175172.478298:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175172.478312:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175172.478320:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145260544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175172.478338:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87e680 x1872931145259776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175172.478360:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145259776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175172.478373:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175172.478378:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175172.478383:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145259776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175172.478392:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145259904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175172.478417:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175172.478428:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87c380 x1872931145259904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175172.478443:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145259904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175172.478453:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175172.478456:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175172.478460:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145259904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175172.478468:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145260032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175172.478488:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175172.478500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87c700 x1872931145260032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175172.478516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145260032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175172.478525:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175172.478528:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175172.478532:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145260032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175172.478539:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145260160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175172.478558:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175172.478569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87c000 x1872931145260160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175172.478582:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145260160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175172.478592:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175172.478596:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175172.478600:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145260160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175172.478607:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145260288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175172.478627:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175172.478638:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87dc00 x1872931145260288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175172.478651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145260288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175172.478669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175172.478673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175172.478677:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145260288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175172.478698:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145260416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175172.478719:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175172.478731:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87f800 x1872931145260416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175172.478745:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145260416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175172.478756:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175172.478760:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175172.478763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145260416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175172.478772:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145260544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175172.478792:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175172.478803:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175172/real 1786175172]  req@ffff89d99e87df80 x1872931145260544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175172.478817:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145260544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175172.478827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175172.478831:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175172.478835:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145260544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175172.989023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175172.989187:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175173.501049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175174.012975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175174.013069:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175174.525071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175175.037090:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175175.037185:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175175.549078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175176.061023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175176.061183:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175176.573024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175177.085028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175177.085105:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175177.597068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175177.597156:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175177.597166:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175177.597171:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175177.597183:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.597195:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175177.597205:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175177.597255:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145260672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175177.597294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175177.597299:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175177.597301:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175177.597306:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.597310:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175177.597324:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175177.597336:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175177.597351:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145260800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175177.597365:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175177.597370:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175177.597372:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175177.597379:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.597384:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175177.597390:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175177.597400:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145260672:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786175177.597401:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175177.597422:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145260928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175177.597444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175177.597449:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175177.597452:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175177.597456:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.597462:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175177.597466:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175177.597472:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175177.597486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145261056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175177.597498:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175177.597502:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175177.597505:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175177.597515:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175177.597520:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.597527:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175177.597534:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175177.597541:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175177.597556:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145261184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175177.597571:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175177.597576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175177.597581:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175177.597584:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2ff800 x1872931145260672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175177.597591:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.597601:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175177.597612:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175177.597624:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175177.597634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145260672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175177.597644:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145261312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175177.597671:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175177.597675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175177.597695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175177.597697:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175177.597705:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175177.597711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145260672:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175177.597718:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.597727:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175177.597736:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145260800:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175177.597737:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175177.597750:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175177.597772:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145261440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175177.597785:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175177.597790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175177.597793:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175177.597799:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175177.597807:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.597815:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175177.597820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2fc380 x1872931145260800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175177.597828:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175177.597841:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175177.597857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145260800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175177.597865:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145261568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175177.597956:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175177.597963:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175177.597974:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145260800:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175177.598001:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175177.598010:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175177.598015:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175177.598026:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8911
00000100:00080000:1.0:1786175177.598034:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175177.598043:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175177.598054:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175177.598109:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145261696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175177.598112:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145260928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175177.598175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175177.598196:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2fd500 x1872931145260928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175177.598213:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145260928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175177.598225:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175177.598228:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175177.598233:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145260928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175177.598240:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145261056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175177.598260:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175177.598271:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2fea00 x1872931145261056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175177.598285:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145261056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175177.598295:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175177.598298:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175177.598301:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145261056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175177.598308:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145261184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175177.598338:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175177.598349:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2ff100 x1872931145261184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175177.598363:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145261184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175177.598373:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175177.598376:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175177.598380:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145261184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175177.598386:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145261312:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175177.598403:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175177.598414:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2fe300 x1872931145261312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175177.598427:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145261312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175177.598436:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175177.598440:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175177.598443:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145261312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175177.598449:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145261440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175177.598467:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175177.598477:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2fdf80 x1872931145261440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175177.598490:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145261440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175177.598500:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175177.598504:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175177.598508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145261440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175177.598514:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145261568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175177.598532:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175177.598543:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2ffb80 x1872931145261568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175177.598555:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145261568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175177.598565:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175177.598569:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175177.598573:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145261568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175177.598597:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145261696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175177.598615:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175177.598626:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175177/real 1786175177]  req@ffff89d9ba2ff800 x1872931145261696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175177.598641:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145261696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175177.598650:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175177.598653:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175177.598658:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145261696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175178.109141:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175178.109269:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175178.621164:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175179.133146:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175179.133147:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175179.645087:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175180.156993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175180.157075:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175180.668949:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175181.181067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175181.181122:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175181.692988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175182.205085:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175182.205224:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175182.717078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175182.717095:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175182.717103:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175182.717108:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717120:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00080000:1.0:1786175182.717130:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175182.717139:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175182.717182:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145261824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175182.717214:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175182.717218:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175182.717220:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717224:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00080000:1.0:1786175182.717228:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175182.717232:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175182.717243:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175182.717259:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145261952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175182.717262:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145261824:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175182.717284:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175182.717288:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175182.717289:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717295:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00080000:1.0:1786175182.717299:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175182.717302:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175182.717308:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175182.717320:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145262080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175182.717331:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175182.717345:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175182.717347:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717352:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00080000:1.0:1786175182.717357:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175182.717363:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175182.717367:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175182.717375:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175182.717387:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145262208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175182.717397:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175182.717401:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175182.717403:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717408:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00080000:1.0:1786175182.717412:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175182.717418:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2fed80 x1872931145261824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175182.717420:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175182.717439:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175182.717446:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145261824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175182.717458:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145262336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175182.717463:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175182.717476:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175182.717477:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175182.717484:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786175182.717487:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145261824:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175182.717489:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717501:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00080000:1.0:1786175182.717505:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175182.717509:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175182.717513:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175182.717523:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145261952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175182.717535:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145262464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175182.717550:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175182.717558:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175182.717560:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175182.717566:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717573:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00080000:1.0:1786175182.717579:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175182.717586:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175182.717586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2fdc00 x1872931145261952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175182.717596:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175182.717630:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145262592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175182.717637:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145261952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175182.717643:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175182.717651:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175182.717654:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717664:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00080000:1.0:1786175182.717669:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175182.717676:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175182.717683:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175182.717697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175182.717698:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145262720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175182.717710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175182.717720:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175182.717722:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145261952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175182.717725:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175182.717731:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175182.717737:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8916
00000100:00100000:3.0:1786175182.717739:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145262080:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175182.717741:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175182.717750:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175182.717755:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175182.717766:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145262848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175182.717778:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175182.717794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2fc700 x1872931145262080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175182.717806:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145262080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175182.717814:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175182.717817:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175182.717820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145262080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175182.717825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145262208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175182.717839:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175182.717847:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2fe680 x1872931145262208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175182.717863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145262208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175182.717873:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175182.717877:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175182.717883:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145262208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175182.717892:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145262336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175182.717946:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175182.717959:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2fd180 x1872931145262336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175182.717971:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145262336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175182.717978:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175182.717981:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175182.717994:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145262336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175182.718060:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145262464:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175182.718085:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175182.718096:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2fce00 x1872931145262464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175182.718107:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145262464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175182.718114:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175182.718117:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175182.718120:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145262464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175182.718127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145262592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175182.718143:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175182.718152:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2fd880 x1872931145262592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175182.718162:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145262592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175182.718169:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175182.718171:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175182.718174:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145262592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175182.718178:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145262720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175182.718191:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175182.718199:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2ff480 x1872931145262720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175182.718209:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145262720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175182.718216:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175182.718219:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175182.718221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145262720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175182.718225:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145262848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175182.718238:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175182.718245:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175182/real 1786175182]  req@ffff89d9ba2fed80 x1872931145262848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175182.718255:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145262848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175182.718262:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175182.718265:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175182.718267:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145262848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175183.228979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175183.229052:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175183.741110:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175184.253110:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175184.253129:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175184.765034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175185.277072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175185.277109:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175185.789050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175186.301142:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175186.301185:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175186.813038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175187.325102:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175187.325160:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175187.837151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175187.837163:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175187.837170:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175187.837180:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175187.837185:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00080000:3.0:1786175187.837204:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.837215:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175187.837265:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145262976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175187.837303:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175187.837308:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175187.837311:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175187.837316:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00080000:3.0:1786175187.837320:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.837324:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175187.837337:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175187.837354:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145263104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175187.837370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175187.837375:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145262976:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175187.837377:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175187.837385:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175187.837411:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00080000:3.0:1786175187.837417:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.837422:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175187.837429:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175187.837451:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145263232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175187.837465:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175187.837469:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175187.837472:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175187.837476:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00080000:3.0:1786175187.837480:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.837484:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175187.837491:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175187.837500:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175187.837512:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145263360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175187.837526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175187.837531:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175187.837535:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175187.837540:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00080000:3.0:1786175187.837545:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.837549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175187.837555:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175187.837576:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe67100 x1872931145262976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175187.837577:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145263488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175187.837627:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175187.837635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175187.837638:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175187.837644:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00100000:2.0:1786175187.837652:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145262976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175187.837653:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.837665:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175187.837670:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175187.837684:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145263616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175187.837718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175187.837719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175187.837731:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175187.837737:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175187.837739:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175187.837755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145262976:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175187.837756:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00080000:3.0:1786175187.837767:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.837775:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175187.837781:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175187.837793:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145263744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175187.837807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175187.837814:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145263104:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175187.837815:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175187.837822:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175187.837832:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00080000:3.0:1786175187.837838:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.837842:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175187.837850:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175187.837872:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145263872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175187.837879:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175187.837935:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175187.837943:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175187.837947:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175187.837954:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe67b80 x1872931145263104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175187.837964:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8922
00000100:00080000:3.0:1786175187.837999:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175187.838018:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175187.838029:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145263104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175187.838034:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175187.838055:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175187.838062:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175187.838069:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145263104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175187.838078:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145264000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175187.838087:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145263232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175187.838139:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175187.838157:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe65180 x1872931145263232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175187.838174:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145263232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175187.838184:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175187.838188:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175187.838191:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145263232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175187.838199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145263360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175187.838221:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175187.838233:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe64380 x1872931145263360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175187.838248:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145263360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175187.838258:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175187.838261:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175187.838264:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145263360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175187.838271:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145263488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175187.838290:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175187.838301:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe66d80 x1872931145263488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175187.838315:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145263488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175187.838325:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175187.838328:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175187.838332:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145263488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175187.838338:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145263616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175187.838356:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175187.838367:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe66680 x1872931145263616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175187.838380:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145263616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175187.838390:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175187.838394:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175187.838401:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145263616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175187.838436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145263744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175187.838477:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175187.838500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe67800 x1872931145263744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175187.838524:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145263744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175187.838535:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175187.838540:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175187.838544:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145263744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175187.838552:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145263872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175187.838579:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175187.838593:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe65f80 x1872931145263872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175187.838608:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145263872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175187.838617:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175187.838623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175187.838629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145263872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175187.838638:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145264000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175187.838661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175187.838672:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175187/real 1786175187]  req@ffff89d99fe67100 x1872931145264000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175187.838686:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145264000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175187.838699:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175187.838702:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175187.838707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145264000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175188.349059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175188.349187:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175188.861125:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175189.373090:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175189.373209:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175189.885095:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175190.397089:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175190.397161:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175190.909046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175191.421040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175191.421092:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175191.932996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175192.444987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175192.445077:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175192.956987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175192.956988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175192.956998:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175192.957003:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175192.957014:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957023:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175192.957031:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175192.957066:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145264128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175192.957103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175192.957107:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175192.957110:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175192.957115:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957119:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175192.957125:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175192.957135:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145264128:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175192.957135:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175192.957157:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145264256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175192.957171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175192.957175:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175192.957177:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175192.957182:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957187:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175192.957191:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175192.957197:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175192.957210:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145264384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175192.957230:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175192.957231:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145264256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175192.957241:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175192.957244:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175192.957250:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957255:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175192.957260:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175192.957266:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175192.957267:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145264384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175192.957349:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145264512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175192.957370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175192.957374:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175192.957376:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175192.957382:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957387:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175192.957392:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175192.957398:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175192.957411:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145264512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175192.957415:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145264640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175192.957430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175192.957434:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175192.957437:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175192.957442:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957447:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175192.957452:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175192.957458:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175192.957459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145264640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175192.957477:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145264768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175192.957499:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175192.957503:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175192.957505:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175192.957510:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957515:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175192.957519:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175192.957523:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145264768:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175192.957525:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175192.957543:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145264896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175192.957554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175192.957558:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175192.957561:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175192.957567:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145264896:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175192.957567:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957574:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175192.957579:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175192.957584:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175192.957598:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145265024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175192.957618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175192.957622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175192.957624:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175192.957629:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8927
00000100:00080000:3.0:1786175192.957633:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175192.957635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145265024:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175192.957641:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175192.957650:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175192.957665:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145265152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175192.957686:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145265152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175193.469038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175193.469058:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175193.981009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175194.493009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175194.493054:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175195.004988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175195.517045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175195.517070:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175196.029024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:3.0:1786175196.029313:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:3.0:1786175196.029383:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1786175196.029403:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175196.031325:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:3.0:1786175196.031344:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175196.031359:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175196.031375:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175196.031394:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175196.031397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe67100 x1872931145265152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786175196.031413:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175196.031434:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145265152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786175196.031440:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175196.031453:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786175196.031467:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031473:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031478:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145265152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175196.031485:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe66a00 x1872931145265024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175196.031498:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145265024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175196.031505:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031508:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145265024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175196.031516:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe66300 x1872931145264896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175196.031535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145264896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175196.031547:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031550:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145264896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175196.031558:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe65880 x1872931145264768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175196.031567:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145264768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175196.031573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031575:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031578:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145264768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175196.031582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe65500 x1872931145264640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175196.031591:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145264640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175196.031597:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031600:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031602:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145264640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175196.031607:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe64700 x1872931145264512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175196.031616:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145264512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175196.031622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031625:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031627:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145264512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175196.031632:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe64a80 x1872931145264384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175196.031642:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145264384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175196.031651:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031656:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145264384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175196.031668:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe67480 x1872931145264256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175196.031694:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145264256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175196.031706:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145264256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175196.031724:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175192/real 1786175196]  req@ffff89d99fe64000 x1872931145264128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175196.031736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145264128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175196.031743:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175196.031746:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175196.031749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145264128:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175196.541003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175196.541076:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175197.052974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175197.565068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175197.565138:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175198.077008:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175198.077016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175198.077027:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175198.077033:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175198.077064:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00080000:3.0:1786175198.077081:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175198.077096:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175198.077167:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145265280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175198.077202:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175198.077206:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175198.077208:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175198.077212:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00080000:3.0:1786175198.077216:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175198.077221:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175198.077231:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175198.077239:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145265280:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175198.077246:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145265408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175198.077258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175198.077261:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175198.077263:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175198.077266:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00080000:3.0:1786175198.077269:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175198.077272:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175198.077276:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175198.077287:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145265536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175198.077296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175198.077299:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175198.077301:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175198.077303:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00080000:3.0:1786175198.077307:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175198.077313:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175198.077315:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175198.077323:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175198.077333:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145265664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175198.077342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175198.077345:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175198.077346:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175198.077350:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00080000:3.0:1786175198.077353:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175198.077356:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175198.077379:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175198.077396:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe65f80 x1872931145265280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175198.077398:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145265792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175198.077456:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175198.077462:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175198.077464:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175198.077468:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00080000:3.0:1786175198.077472:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175198.077476:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175198.077479:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175198.077487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145265920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175198.077493:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145265280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175198.077507:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175198.077515:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175198.077517:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175198.077518:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175198.077530:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.077538:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145265280:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175198.077545:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00080000:3.0:1786175198.077553:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175198.077560:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175198.077567:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175198.077577:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145265408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175198.077587:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145266048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175198.077613:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175198.077615:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175198.077624:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175198.077628:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175198.077635:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00100000:0.0:1786175198.077641:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe67800 x1872931145265408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175198.077644:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175198.077656:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175198.077670:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175198.077678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145265408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175198.077694:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145266176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175198.077698:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175198.077713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.077724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145265408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175198.077741:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175198.077744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145265536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175198.077749:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175198.077755:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175198.077764:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8932
00000100:00080000:3.0:1786175198.077773:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175198.077779:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175198.077787:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175198.077791:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175198.077808:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145266304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175198.077844:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe66680 x1872931145265536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175198.077863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145265536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175198.077954:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175198.077959:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.077964:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145265536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175198.077972:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145265664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175198.078006:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175198.078025:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe66d80 x1872931145265664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175198.078041:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145265664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175198.078052:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175198.078056:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.078061:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145265664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175198.078070:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145265792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175198.078095:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175198.078110:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe64380 x1872931145265792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175198.078127:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145265792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175198.078138:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175198.078143:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.078148:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145265792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175198.078165:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145265920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175198.078201:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175198.078218:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe65180 x1872931145265920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175198.078233:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145265920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175198.078244:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175198.078248:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.078253:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145265920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175198.078281:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145266048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175198.078309:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175198.078326:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe67b80 x1872931145266048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175198.078355:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145266048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175198.078367:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175198.078371:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.078375:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145266048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175198.078385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145266176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175198.078414:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175198.078431:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe65f80 x1872931145266176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175198.078448:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145266176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175198.078459:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175198.078464:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.078468:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145266176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175198.078477:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145266304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175198.078504:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175198.078520:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175198/real 1786175198]  req@ffff89d99fe64000 x1872931145266304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175198.078546:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145266304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175223 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175198.078566:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175198.078571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175198.078577:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145266304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175198.588986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175198.589092:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175199.101023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175199.613035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175199.613124:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175200.124996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175200.637009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175200.637081:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175201.148994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175201.660988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175201.661109:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175202.173012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175202.685007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175202.685022:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175203.197101:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.197118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175203.197125:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175203.197156:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175203.197159:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00080000:1.0:1786175203.197187:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175203.197212:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175203.197268:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145266432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175203.197315:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.197322:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175203.197326:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175203.197334:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00080000:1.0:1786175203.197341:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175203.197350:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175203.197366:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175203.197392:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145266560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175203.197402:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145266432:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175203.197431:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.197438:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175203.197441:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175203.197451:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00080000:1.0:1786175203.197458:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175203.197465:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175203.197476:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175203.197498:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145266688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175203.197519:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175203.197523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.197533:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175203.197537:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175203.197549:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00080000:1.0:1786175203.197559:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175203.197566:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175203.197576:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175203.197599:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2ff800 x1872931145266432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175203.197603:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145266816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175203.197671:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.197677:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175203.197681:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175203.197687:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145266432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175203.197695:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00080000:1.0:1786175203.197710:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175203.197718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175203.197722:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175203.197731:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786175203.197739:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175203.197740:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145266432:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175203.197774:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145266944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175203.197798:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145266560:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175203.197807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.197817:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175203.197821:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175203.197859:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00080000:1.0:1786175203.197872:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175203.197881:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175203.197890:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175203.197944:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2ffb80 x1872931145266560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175203.197965:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145266560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175203.197966:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175203.197990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175203.197998:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175203.198009:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145266560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175203.198011:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145267072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175203.198024:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145266688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175203.198054:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.198062:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000800:00000100:0.0:1786175203.198070:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175203.198071:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175203.198088:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00100000:0.0:1786175203.198095:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2fdf80 x1872931145266688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175203.198101:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175203.198119:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175203.198128:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145266688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175203.198135:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175203.198142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175203.198149:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175203.198154:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145266688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175203.198169:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145266816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175203.198172:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145267200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175203.198203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.198211:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:0.0:1786175203.198213:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175203.198222:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175203.198237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2fe300 x1872931145266816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175203.198238:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00080000:1.0:1786175203.198255:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175203.198272:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175203.198283:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145266816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175203.198285:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175203.198311:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175203.198321:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145267328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175203.198328:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175203.198347:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145266816:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175203.198357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175203.198366:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175203.198370:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175203.198380:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8937
00000100:00080000:1.0:1786175203.198389:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175203.198399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145266944:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175203.198402:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175203.198418:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175203.198444:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145267456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175203.198462:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175203.198505:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2ff100 x1872931145266944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175203.198533:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145266944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175203.198545:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175203.198550:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175203.198554:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145266944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175203.198563:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145267072:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175203.198599:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175203.198623:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2fea00 x1872931145267072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175203.198649:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145267072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175203.198666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175203.198673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175203.198679:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145267072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175203.198687:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145267200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175203.198714:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175203.198729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2fd500 x1872931145267200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175203.198743:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145267200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175203.198754:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175203.198758:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175203.198762:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145267200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175203.198768:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145267328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175203.198796:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175203.198807:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2fc380 x1872931145267328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175203.198820:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145267328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175203.198858:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175203.198863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175203.198867:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145267328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175203.198891:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145267456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175203.198948:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175203.198965:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175203/real 1786175203]  req@ffff89d9ba2fe300 x1872931145267456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175203.198980:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145267456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175203.198990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175203.198994:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175203.198998:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145267456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175203.708974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175203.709047:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175204.221015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175204.733006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175204.733146:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175205.244984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175205.757037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175205.757166:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175206.268958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175206.781086:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175206.781166:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175207.293026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175207.805019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175207.805284:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175208.317030:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175208.317041:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1786175208.317043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175208.317045:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317058:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00080000:2.0:1786175208.317068:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175208.317076:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175208.317113:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145267584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175208.317137:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175208.317141:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175208.317143:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317146:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00080000:2.0:1786175208.317149:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175208.317152:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175208.317161:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175208.317172:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145267712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175208.317184:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175208.317188:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145267584:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175208.317189:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175208.317192:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317201:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00080000:2.0:1786175208.317204:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175208.317208:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175208.317212:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175208.317225:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145267840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175208.317233:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175208.317236:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175208.317238:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317242:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00080000:2.0:1786175208.317245:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175208.317248:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175208.317252:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175208.317263:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145267968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175208.317272:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175208.317280:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175208.317285:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175208.317287:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317291:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00080000:2.0:1786175208.317295:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175208.317299:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175208.317302:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175208.317311:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145268096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175208.317323:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175208.317327:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175208.317329:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317333:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00080000:2.0:1786175208.317336:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175208.317342:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175208.317346:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87f100 x1872931145267584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175208.317347:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175208.317361:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145268224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175208.317379:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175208.317383:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175208.317384:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317390:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00100000:0.0:1786175208.317391:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145267584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175208.317393:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175208.317401:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175208.317409:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175208.317420:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175208.317424:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145268352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175208.317429:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.317441:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145267584:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175208.317444:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175208.317450:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175208.317452:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317456:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00080000:2.0:1786175208.317460:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175208.317463:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175208.317468:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175208.317473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145267712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175208.317480:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145268480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175208.317492:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175208.317495:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175208.317497:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175208.317500:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8942
00000100:00080000:2.0:1786175208.317504:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175208.317509:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175208.317512:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175208.317519:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175208.317532:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87d500 x1872931145267712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175208.317533:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145268608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175208.317583:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145267712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175208.317593:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175208.317597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.317600:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145267712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175208.317608:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145267840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175208.317624:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175208.317633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87d880 x1872931145267840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175208.317643:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145267840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175208.317650:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175208.317652:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.317655:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145267840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175208.317660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145267968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175208.317673:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175208.317680:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87df80 x1872931145267968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175208.317689:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145267968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175208.317696:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175208.317698:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.317701:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145267968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175208.317705:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145268096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175208.317717:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175208.317724:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87f800 x1872931145268096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175208.317734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145268096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175208.317741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175208.317743:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.317745:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145268096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175208.317749:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145268224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175208.317762:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175208.317769:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87dc00 x1872931145268224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175208.317803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145268224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175208.317810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175208.317813:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.317816:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145268224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175208.317821:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145268352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175208.317839:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175208.317849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87c000 x1872931145268352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175208.317858:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145268352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175208.317871:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175208.317873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.317876:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145268352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175208.317893:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145268480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175208.317950:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175208.317966:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87c700 x1872931145268480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175208.317984:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145268480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175208.317994:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175208.317997:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.317999:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145268480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175208.318005:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145268608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175208.318029:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175208.318044:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175208/real 1786175208]  req@ffff89d99e87c380 x1872931145268608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175208.318062:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145268608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175208.318074:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175208.318078:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175208.318083:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145268608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175208.829071:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175208.829160:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175209.341023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175209.853011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175209.853146:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175210.365066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175210.877018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175210.877100:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175211.389028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175211.901050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175211.901131:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175212.413031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175212.925049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175212.925190:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175213.437049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175213.437089:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175213.437100:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175213.437106:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175213.437119:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.437131:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175213.437142:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175213.437190:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145268736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175213.437226:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175213.437232:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175213.437234:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175213.437242:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.437247:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175213.437253:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175213.437268:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175213.437282:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145268736:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175213.437298:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145268864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175213.437323:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175213.437330:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175213.437334:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175213.437342:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.437366:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175213.437372:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175213.437380:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175213.437383:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175213.437403:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145268992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175213.437418:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175213.437422:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175213.437425:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175213.437430:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.437436:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175213.437439:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175213.437446:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175213.437459:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2fdf80 x1872931145268736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175213.437462:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145269120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175213.437508:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175213.437512:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175213.437514:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175213.437518:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.437525:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175213.437535:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175213.437556:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175213.437559:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145268736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175213.437584:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145269248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175213.437585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175213.437604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175213.437622:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145268736:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175213.437623:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175213.437640:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175213.437645:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175213.437652:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.437658:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175213.437664:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175213.437671:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175213.437710:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145268864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175213.437713:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145269376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175213.437809:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175213.437819:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175213.437822:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175213.437831:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175213.437841:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.437851:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175213.437861:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2ffb80 x1872931145268864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175213.437865:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175213.437883:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175213.437907:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145268864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175213.437950:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145269504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175213.438009:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175213.438013:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175213.438015:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175213.438021:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175213.438034:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175213.438035:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.438049:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175213.438058:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145268864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175213.438062:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175213.438075:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175213.438088:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145268992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175213.438094:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145269632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175213.438111:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175213.438116:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175213.438119:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175213.438123:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8947
00000100:00080000:1.0:1786175213.438129:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175213.438134:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175213.438140:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175213.438156:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175213.438158:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145269760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175213.438193:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2ff800 x1872931145268992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175213.438222:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145268992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175213.438238:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175213.438244:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175213.438251:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145268992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175213.438264:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145269120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175213.438301:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175213.438324:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2fed80 x1872931145269120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175213.438346:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145269120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175213.438378:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175213.438385:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175213.438391:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145269120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175213.438404:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145269248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175213.438441:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175213.438463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2ff480 x1872931145269248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175213.438502:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145269248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175213.438519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175213.438526:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175213.438533:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145269248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175213.438587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145269376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175213.438622:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175213.438645:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2fd880 x1872931145269376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175213.438686:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145269376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175213.438703:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175213.438709:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175213.438716:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145269376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175213.438778:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145269504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175213.438816:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175213.438838:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2fce00 x1872931145269504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175213.438861:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145269504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175213.438887:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175213.438894:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175213.438933:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145269504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175213.438945:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145269632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175213.438983:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175213.439006:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2fd180 x1872931145269632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175213.439028:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145269632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175213.439044:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175213.439051:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175213.439056:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145269632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175213.439068:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145269760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175213.439120:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175213.439143:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175213/real 1786175213]  req@ffff89d9ba2fe680 x1872931145269760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175213.439166:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145269760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175213.439182:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175213.439187:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175213.439195:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145269760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175213.949004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175213.949152:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175214.461040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175214.973020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175214.973127:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175215.485065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175215.997025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175215.997266:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175216.509118:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175217.021001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175217.021073:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175217.533021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175218.045073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175218.045156:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175218.557075:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557088:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175218.557095:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175218.557107:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00100000:3.0:1786175218.557117:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175218.557119:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175218.557137:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175218.557195:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145269888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175218.557226:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557232:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175218.557234:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175218.557239:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00080000:2.0:1786175218.557244:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175218.557250:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175218.557263:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175218.557298:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145269888:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175218.557299:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145270016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175218.557322:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557326:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175218.557328:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175218.557344:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00080000:2.0:1786175218.557350:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175218.557355:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175218.557367:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175218.557389:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175218.557393:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145270144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175218.557417:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557422:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175218.557424:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175218.557429:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00080000:2.0:1786175218.557434:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175218.557437:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175218.557444:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175218.557453:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87e680 x1872931145269888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175218.557461:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145270272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175218.557478:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557481:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175218.557483:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175218.557501:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00080000:2.0:1786175218.557507:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175218.557511:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145269888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175218.557516:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175218.557525:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175218.557540:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175218.557547:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145270400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175218.557553:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175218.557566:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145269888:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175218.557572:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557578:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175218.557580:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175218.557603:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00080000:2.0:1786175218.557607:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175218.557612:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175218.557619:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175218.557626:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145270016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175218.557641:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145270528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175218.557657:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557701:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175218.557705:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175218.557716:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175218.557718:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00080000:2.0:1786175218.557747:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175218.557753:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175218.557760:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175218.557766:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87ed80 x1872931145270016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175218.557780:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145270656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175218.557788:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145270016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175218.557804:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557813:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175218.557814:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175218.557817:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175218.557824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175218.557829:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00080000:2.0:1786175218.557836:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175218.557837:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145270016:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175218.557846:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175218.557854:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145270144:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175218.557855:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175218.557875:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145270784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175218.557887:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175218.557894:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1786175218.557895:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175218.557898:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175218.557908:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8952
00000100:00080000:2.0:1786175218.557913:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175218.557958:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175218.557967:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87ca80 x1872931145270144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175218.557968:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175218.557993:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145270144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175218.558003:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145270912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175218.558007:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175218.558020:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175218.558031:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145270144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175218.558064:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145270272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175218.558099:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175218.558114:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87c380 x1872931145270272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175218.558128:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145270272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175218.558138:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175218.558142:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175218.558146:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145270272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175218.558153:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145270400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175218.558172:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175218.558183:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87c700 x1872931145270400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175218.558207:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145270400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175218.558216:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175218.558220:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175218.558223:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145270400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175218.558245:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145270528:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175218.558265:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175218.558276:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87c000 x1872931145270528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175218.558290:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145270528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175218.558317:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175218.558320:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175218.558324:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145270528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175218.558329:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145270656:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175218.558346:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175218.558355:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87dc00 x1872931145270656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175218.558365:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145270656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175218.558380:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175218.558382:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175218.558385:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145270656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175218.558390:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145270784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175218.558404:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175218.558419:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87f800 x1872931145270784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175218.558430:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145270784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175218.558438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175218.558441:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175218.558444:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145270784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175218.558449:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145270912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175218.558463:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175218.558471:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175218/real 1786175218]  req@ffff89d99e87df80 x1872931145270912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175218.558482:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145270912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175218.558490:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175218.558492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175218.558496:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145270912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175219.068993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175219.069062:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175219.581038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175220.093013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175220.093106:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175220.605023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175221.116989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175221.117050:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175221.628979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175222.141002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175222.141092:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175222.653005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175223.165062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175223.165123:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175223.677078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175223.677119:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175223.677133:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175223.677140:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.677155:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:1.0:1786175223.677173:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175223.677184:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175223.677258:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145271040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175223.677300:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175223.677306:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175223.677315:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.677321:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:1.0:1786175223.677326:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175223.677332:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175223.677347:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175223.677368:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145271168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175223.677383:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175223.677388:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175223.677391:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.677396:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:1.0:1786175223.677399:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175223.677405:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175223.677415:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145271040:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786175223.677416:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175223.677440:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145271296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175223.677456:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175223.677472:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175223.677475:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.677479:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:1.0:1786175223.677482:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175223.677487:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175223.677494:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175223.677508:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145271424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175223.677520:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175223.677525:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175223.677528:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.677534:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:1.0:1786175223.677539:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175223.677545:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175223.677564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786175223.677566:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175223.677585:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145271552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175223.677599:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175223.677604:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175223.677606:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.677611:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:1.0:1786175223.677615:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175223.677620:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175223.677650:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175223.677667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145271680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175223.677688:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175223.677690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2fc700 x1872931145271040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175223.677700:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175223.677707:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.677723:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:1.0:1786175223.677731:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175223.677736:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175223.677743:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175223.677755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145271040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175223.677759:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145271808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175223.677803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175223.677809:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175223.677812:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.677829:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:0.0:1786175223.677838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175223.677840:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175223.677852:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175223.677860:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175223.677868:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145271040:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786175223.677876:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175223.677885:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145271168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175223.677972:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145271936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175223.677997:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175223.678005:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1786175223.678007:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175223.678010:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175223.678020:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8957
00000100:00080000:1.0:1786175223.678027:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175223.678035:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175223.678044:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175223.678052:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2fdc00 x1872931145271168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175223.678069:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145272064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175223.678080:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145271168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175223.678101:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175223.678107:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175223.678113:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145271168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175223.678160:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145271296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175223.678187:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175223.678202:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2fe680 x1872931145271296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175223.678218:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145271296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175223.678229:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175223.678234:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175223.678238:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145271296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175223.678245:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145271424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175223.678266:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175223.678277:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2fd180 x1872931145271424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175223.678292:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145271424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175223.678302:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175223.678305:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175223.678309:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145271424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175223.678315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145271552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175223.678335:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175223.678346:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2fce00 x1872931145271552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175223.678361:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145271552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175223.678371:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175223.678374:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175223.678378:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145271552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175223.678384:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145271680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175223.678404:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175223.678414:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2fd880 x1872931145271680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175223.678429:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145271680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175223.678439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175223.678442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175223.678446:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145271680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175223.678452:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145271808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175223.678475:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175223.678486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2ff480 x1872931145271808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175223.678499:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145271808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175223.678516:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175223.678520:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175223.678524:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145271808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175223.678530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145271936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175223.678560:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175223.678571:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2fed80 x1872931145271936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175223.678584:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145271936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175223.678594:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175223.678597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175223.678601:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145271936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175223.678607:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145272064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175223.678653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175223.678671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175223/real 1786175223]  req@ffff89d9ba2ff800 x1872931145272064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175223.678697:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145272064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175223.678708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175223.678711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175223.678717:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145272064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175224.189073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175224.189145:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175224.701003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175225.213060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175225.213155:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175225.724989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175226.237067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175226.237176:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175226.748973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175227.260957:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175227.261023:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175227.773035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175228.285122:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175228.285168:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175228.796992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175228.796995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175228.797004:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175228.797008:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175228.797016:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00080000:1.0:1786175228.797024:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175228.797032:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175228.797062:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145272192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175228.797094:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175228.797099:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175228.797101:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175228.797106:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00080000:1.0:1786175228.797111:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175228.797116:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175228.797126:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175228.797142:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145272320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175228.797143:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145272192:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175228.797160:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175228.797163:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175228.797165:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175228.797168:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00080000:1.0:1786175228.797172:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175228.797175:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175228.797180:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175228.797190:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145272448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175228.797197:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175228.797200:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175228.797201:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175228.797203:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00080000:1.0:1786175228.797206:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175228.797211:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175228.797214:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175228.797219:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175228.797228:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145272576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175228.797235:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175228.797237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175228.797238:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175228.797242:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00080000:1.0:1786175228.797245:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175228.797247:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175228.797252:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175228.797252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2ffb80 x1872931145272192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175228.797264:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145272704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175228.797271:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175228.797273:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145272192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175228.797275:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175228.797279:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175228.797288:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00080000:1.0:1786175228.797293:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175228.797293:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175228.797298:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175228.797301:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786175228.797303:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175228.797307:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145272192:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175228.797315:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145272832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175228.797323:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175228.797325:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175228.797326:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175228.797330:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00100000:2.0:1786175228.797333:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145272320:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175228.797334:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175228.797341:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175228.797345:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175228.797354:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145272960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175228.797362:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175228.797363:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175228.797366:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175228.797368:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175228.797372:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00080000:1.0:1786175228.797374:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175228.797376:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2fdf80 x1872931145272320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175228.797380:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175228.797386:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175228.797394:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145272320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175228.797399:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145273088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175228.797409:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175228.797414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175228.797417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175228.797419:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175228.797423:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175228.797424:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145272320:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175228.797429:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8963
00000100:00080000:1.0:1786175228.797432:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175228.797434:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145272448:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175228.797438:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175228.797444:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175228.797454:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145273216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175228.797461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175228.797474:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2fe300 x1872931145272448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175228.797485:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145272448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175228.797491:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175228.797493:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175228.797495:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145272448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175228.797499:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145272576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175228.797512:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175228.797519:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2fc380 x1872931145272576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175228.797527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145272576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175228.797533:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175228.797535:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175228.797538:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145272576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175228.797543:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145272704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175228.797556:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175228.797566:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2fd500 x1872931145272704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175228.797589:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145272704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175228.797596:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175228.797600:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175228.797604:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145272704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175228.797611:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145272832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175228.797630:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175228.797640:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2fea00 x1872931145272832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175228.797650:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145272832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175228.797655:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175228.797657:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175228.797659:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145272832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175228.797671:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145272960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175228.797682:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175228.797688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2ff100 x1872931145272960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175228.797708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145272960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175228.797714:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175228.797716:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175228.797718:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145272960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175228.797721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145273088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175228.797733:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175228.797739:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2ffb80 x1872931145273088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175228.797747:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145273088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175228.797752:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175228.797753:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175228.797755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145273088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175228.797758:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145273216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175228.797767:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175228.797773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175228/real 1786175228]  req@ffff89d9ba2ff800 x1872931145273216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175228.797780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145273216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175228.797790:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175228.797792:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175228.797794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145273216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175229.309003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175229.309123:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175229.821033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175230.333057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175230.333157:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175230.845035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175231.357053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175231.357183:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175231.869041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175232.381062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175232.381172:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175232.893061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175233.405084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175233.405175:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175233.917002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175233.917051:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917061:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175233.917067:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175233.917082:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917096:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917108:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175233.917160:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145273344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175233.917190:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917194:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175233.917197:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175233.917201:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917205:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917209:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175233.917220:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175233.917235:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145273472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175233.917249:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917260:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175233.917264:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175233.917265:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145273344:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175233.917272:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917287:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917294:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175233.917310:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175233.917324:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145273600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175233.917336:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917339:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175233.917341:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175233.917345:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917348:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917351:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175233.917356:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175233.917367:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145273728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175233.917376:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917380:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175233.917381:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175233.917385:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917388:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917390:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175233.917394:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175233.917401:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145273856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175233.917409:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917412:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175233.917413:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175233.917417:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917420:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917427:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175233.917434:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175233.917438:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175233.917448:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145273984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175233.917458:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917462:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175233.917466:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175233.917472:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917486:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917491:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175233.917496:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175233.917509:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145274112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175233.917521:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917558:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175233.917561:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175233.917561:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2fed80 x1872931145273344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175233.917583:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917600:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917620:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175233.917631:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175233.917645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145273344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175233.917653:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145274240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175233.917683:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175233.917693:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175233.917694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175233.917698:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175233.917703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.917719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145273344:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175233.917728:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8968
00000100:00080000:1.0:1786175233.917738:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175233.917747:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175233.917757:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175233.917771:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145273472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175233.917784:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145274368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175233.917815:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175233.917840:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2ff480 x1872931145273472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175233.917857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145273472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175233.917869:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175233.917873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.917877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145273472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175233.917885:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145273600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175233.918012:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175233.918036:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2fd880 x1872931145273600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175233.918060:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145273600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175233.918077:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175233.918083:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.918088:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145273600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175233.918098:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145273728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175233.918140:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175233.918161:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2fce00 x1872931145273728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175233.918186:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145273728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175233.918199:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175233.918203:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.918207:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145273728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175233.918215:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145273856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175233.918243:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175233.918257:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2fd180 x1872931145273856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175233.918271:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145273856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175233.918281:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175233.918285:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.918288:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145273856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175233.918295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145273984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175233.918313:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175233.918322:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2fe680 x1872931145273984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175233.918360:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145273984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175233.918377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175233.918384:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.918390:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145273984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175233.918403:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145274112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175233.918443:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175233.918464:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2fdc00 x1872931145274112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175233.918480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145274112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175233.918499:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175233.918503:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.918508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145274112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175233.918516:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145274240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175233.918593:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175233.918607:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2fc700 x1872931145274240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175233.918621:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145274240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175233.918632:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175233.918636:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.918640:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145274240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175233.918672:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145274368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175233.918693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175233.918705:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175233/real 1786175233]  req@ffff89d9ba2fed80 x1872931145274368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175233.918719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145274368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175233.918728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175233.918731:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175233.918735:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145274368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175234.429074:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175234.429265:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175234.941112:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175235.453140:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175235.453150:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175235.965068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175236.477104:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175236.477277:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175236.988995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175237.501103:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175237.501166:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175238.013032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175238.525075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175238.525152:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175239.037031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175239.037147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175239.037160:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175239.037167:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175239.037183:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.037197:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175239.037207:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175239.037257:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145274496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175239.037301:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175239.037306:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175239.037309:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175239.037314:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.037318:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175239.037324:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175239.037335:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175239.037353:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145274624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175239.037369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175239.037383:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145274496:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175239.037384:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175239.037392:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175239.037413:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.037417:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175239.037421:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175239.037429:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175239.037450:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145274752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175239.037463:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175239.037468:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175239.037470:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175239.037475:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.037513:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175239.037518:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175239.037526:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175239.037548:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145274880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175239.037566:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175239.037585:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175239.037591:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175239.037594:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175239.037602:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.037619:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175239.037625:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175239.037634:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175239.037653:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145275008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175239.037663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f3100 x1872931145274496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175239.037681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175239.037710:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175239.037720:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175239.037733:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.037737:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175239.037747:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175239.037749:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145274496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175239.037767:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175239.037798:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175239.037800:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145275136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175239.037828:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175239.037830:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175239.037853:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175239.037856:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175239.037865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145274496:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175239.037868:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.037877:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175239.037889:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175239.037948:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175239.037965:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145275264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175239.037977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175239.037981:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175239.037984:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175239.037990:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.037995:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175239.038006:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145274624:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175239.038010:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175239.038035:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175239.038056:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145275392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175239.038078:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175239.038081:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175239.038092:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175239.038096:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175239.038105:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f0a80 x1872931145274624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175239.038110:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8973
00000100:00080000:0.0:1786175239.038134:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175239.038143:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145274624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175239.038155:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175239.038177:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175239.038181:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175239.038188:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175239.038198:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145274624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175239.038217:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145274752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175239.038218:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145275520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175239.038273:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175239.038298:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f1180 x1872931145274752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175239.038314:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145274752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175239.038325:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175239.038329:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175239.038333:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145274752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175239.038341:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145274880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175239.038364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175239.038375:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f1880 x1872931145274880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175239.038390:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145274880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175239.038400:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175239.038404:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175239.038407:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145274880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175239.038414:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145275008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175239.038433:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175239.038445:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f0e00 x1872931145275008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175239.038459:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145275008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175239.038470:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175239.038474:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175239.038506:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145275008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175239.038515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145275136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175239.038544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175239.038559:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f2a00 x1872931145275136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175239.038574:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145275136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175239.038584:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175239.038588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175239.038591:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145275136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175239.038599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145275264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175239.038619:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175239.038630:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f2d80 x1872931145275264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175239.038645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145275264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175239.038654:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175239.038658:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175239.038662:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145275264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175239.038691:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145275392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175239.038713:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175239.038725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f3480 x1872931145275392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175239.038738:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145275392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175239.038750:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175239.038754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175239.038758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145275392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175239.038765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145275520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175239.038794:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175239.038814:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175239/real 1786175239]  req@ffff89d9870f3b80 x1872931145275520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175239.038838:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145275520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175264 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175239.038856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175239.038863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175239.038870:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145275520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175239.549086:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175239.549202:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175240.061049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175240.573041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175240.573264:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175241.085044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175241.597184:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175241.597194:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175242.108994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175242.621030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175242.621118:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175243.133044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175243.645136:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175243.645280:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175244.157066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175244.157072:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175244.157088:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175244.157096:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157114:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00080000:0.0:1786175244.157131:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175244.157144:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175244.157213:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145275648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175244.157259:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175244.157265:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175244.157268:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157273:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00080000:0.0:1786175244.157278:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175244.157283:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175244.157298:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175244.157319:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145275776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175244.157331:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145275648:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175244.157341:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175244.157349:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175244.157351:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157358:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00080000:0.0:1786175244.157363:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175244.157370:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175244.157381:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175244.157409:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145275904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175244.157461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175244.157469:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175244.157474:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157483:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00080000:0.0:1786175244.157492:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175244.157501:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175244.157509:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175244.157525:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175244.157551:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145276032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175244.157565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175244.157570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175244.157573:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157579:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00080000:0.0:1786175244.157587:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175244.157592:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175244.157600:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175244.157604:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f2680 x1872931145275648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175244.157620:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145276160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175244.157640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175244.157645:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175244.157652:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157657:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00080000:0.0:1786175244.157662:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175244.157668:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175244.157676:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145275648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175244.157677:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175244.157698:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145276288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175244.157703:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175244.157722:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175244.157725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175244.157734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145275648:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175244.157736:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175244.157744:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157754:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00080000:0.0:1786175244.157757:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175244.157762:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175244.157768:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175244.157780:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145276416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175244.157794:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175244.157798:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145275776:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175244.157801:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175244.157808:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157821:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00080000:0.0:1786175244.157825:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175244.157831:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175244.157837:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175244.157856:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145276544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175244.157871:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175244.157873:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175244.157881:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175244.157886:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175244.157943:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8978
00000100:00100000:2.0:1786175244.157944:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f1500 x1872931145275776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175244.157956:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175244.157973:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175244.157980:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175244.157981:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145275776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175244.158003:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175244.158006:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145276672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175244.158014:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175244.158031:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145275776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175244.158053:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145275904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175244.158101:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175244.158126:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f0700 x1872931145275904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175244.158153:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145275904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175244.158174:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175244.158178:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175244.158183:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145275904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175244.158191:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145276032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175244.158221:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175244.158235:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f3b80 x1872931145276032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175244.158250:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145276032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175244.158260:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175244.158263:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175244.158267:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145276032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175244.158274:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145276160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175244.158294:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175244.158305:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f3480 x1872931145276160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175244.158320:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145276160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175244.158330:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175244.158333:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175244.158338:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145276160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175244.158345:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145276288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175244.158364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175244.158375:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f2d80 x1872931145276288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175244.158389:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145276288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175244.158399:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175244.158402:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175244.158405:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145276288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175244.158462:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145276416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175244.158491:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175244.158506:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f2a00 x1872931145276416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175244.158527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145276416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175244.158542:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175244.158549:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175244.158555:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145276416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175244.158568:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145276544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175244.158607:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175244.158630:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f0e00 x1872931145276544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175244.158647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145276544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175244.158659:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175244.158662:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175244.158667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145276544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175244.158675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145276672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175244.158700:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175244.158712:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175244/real 1786175244]  req@ffff89d9870f1880 x1872931145276672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175244.158726:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145276672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175244.158737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175244.158740:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175244.158743:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145276672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175244.669037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175244.669139:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175245.181023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175245.693053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175245.693194:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175246.205123:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175246.717113:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175246.717205:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175247.229055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175247.741080:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175247.741208:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175248.253063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175248.764985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175248.765054:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175249.277000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175249.277001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175249.277011:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175249.277022:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175249.277032:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277042:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277049:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175249.277085:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145276800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175249.277111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175249.277114:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175249.277116:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175249.277119:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277121:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277124:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175249.277132:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175249.277142:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145276928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175249.277151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175249.277156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175249.277160:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175249.277164:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277166:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277169:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175249.277173:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175249.277187:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145277056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175249.277201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175249.277208:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1786175249.277211:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145276800:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175249.277212:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175249.277227:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277233:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277239:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175249.277245:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175249.277260:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145277184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175249.277269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175249.277272:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175249.277274:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175249.277279:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277282:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277287:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175249.277293:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175249.277300:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145277312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175249.277309:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175249.277312:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175249.277313:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175249.277317:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277319:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277326:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786175249.277336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175249.277338:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175249.277353:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145277440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175249.277362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175249.277366:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175249.277368:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175249.277373:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277376:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277408:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175249.277415:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175249.277427:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145277568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175249.277439:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175249.277441:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f1180 x1872931145276800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175249.277442:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175249.277447:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175249.277459:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277469:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277478:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175249.277487:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175249.277497:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145276800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175249.277510:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145277696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175249.277520:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175249.277523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175249.277535:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175249.277536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175249.277545:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175249.277552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145276800:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175249.277558:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8983
00000100:00080000:0.0:1786175249.277572:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175249.277578:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175249.277583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145276928:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175249.277589:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175249.277604:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145277824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175249.277651:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175249.277673:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f0a80 x1872931145276928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175249.277722:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145276928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175249.277733:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175249.277737:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175249.277762:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145276928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175249.277802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145277056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175249.277831:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175249.277845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f3100 x1872931145277056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175249.277877:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145277056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175249.277887:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175249.277891:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175249.277895:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145277056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175249.277995:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145277184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175249.278020:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175249.278032:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f1880 x1872931145277184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175249.278044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145277184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175249.278052:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175249.278055:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175249.278058:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145277184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175249.278064:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145277312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175249.278080:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175249.278088:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f0e00 x1872931145277312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175249.278099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145277312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175249.278106:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175249.278108:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175249.278111:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145277312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175249.278116:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145277440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175249.278131:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175249.278139:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f2a00 x1872931145277440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175249.278152:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145277440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175249.278159:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175249.278162:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175249.278165:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145277440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175249.278170:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145277568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175249.278184:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175249.278192:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f2d80 x1872931145277568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175249.278203:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145277568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175249.278210:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175249.278213:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175249.278216:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145277568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175249.278221:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145277696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175249.278236:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175249.278244:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f3480 x1872931145277696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175249.278255:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145277696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175249.278269:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175249.278273:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175249.278276:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145277696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175249.278281:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145277824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175249.278295:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175249.278303:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175249/real 1786175249]  req@ffff89d9870f3b80 x1872931145277824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175249.278314:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145277824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175249.278321:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175249.278324:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175249.278327:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145277824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175249.789079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175249.789204:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175250.301082:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175250.813082:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175250.813151:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175251.325042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175251.837097:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175251.837196:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175252.349052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175252.861061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175252.861189:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175253.373021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175253.885007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175253.885181:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175254.397045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175254.397138:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175254.397152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175254.397160:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175254.397176:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8988
00000100:00080000:2.0:1786175254.397194:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175254.397206:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175254.397273:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145277952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175254.397324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175254.397372:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175254.397375:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175254.397381:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8988
00000100:00080000:2.0:1786175254.397389:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175254.397396:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175254.397411:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175254.397415:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145277952:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175254.397434:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145278080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175254.397457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175254.397462:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175254.397466:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175254.397473:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8988
00000100:00080000:2.0:1786175254.397478:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175254.397484:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175254.397491:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175254.397518:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175254.397527:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145278208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175254.397543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175254.397549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175254.397551:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175254.397556:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8988
00000100:00080000:2.0:1786175254.397563:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175254.397568:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175254.397577:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175254.397586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87d880 x1872931145277952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175254.397598:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145278336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175254.397660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175254.397666:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145277952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175254.397668:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175254.397675:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175254.397709:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8988
00000100:00080000:2.0:1786175254.397717:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175254.397718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175254.397734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175254.397735:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786175254.397758:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175254.397761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145277952:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175254.397781:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145278464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175254.397799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175254.397804:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786175254.397811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145278080:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175254.397812:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175254.397833:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8988
00000100:00080000:2.0:1786175254.397842:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175254.397850:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175254.397858:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175254.397881:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145278592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175254.397884:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175254.397953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175254.397959:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175254.397964:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175254.397972:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8988
00000100:00080000:2.0:1786175254.397983:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175254.397990:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175254.397998:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175254.398001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87d500 x1872931145278080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175254.398018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145278720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175254.398035:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145278080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175254.398043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175254.398071:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175254.398079:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175254.398095:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175254.398096:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8988
00000100:00080000:2.0:1786175254.398117:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175254.398123:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175254.398134:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175254.398144:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145278080:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175254.398149:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175254.398169:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145278208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175254.398179:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145278848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175254.398200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175254.398205:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175254.398209:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175254.398216:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8988
00000800:00000100:0.0:1786175254.398229:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175254.398232:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175254.398242:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175254.398255:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175254.398262:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87f100 x1872931145278208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175254.398281:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145278976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175254.398296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145278208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175254.398360:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175254.398369:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175254.398379:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145278208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175254.398392:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145278336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175254.398425:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175254.398439:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87df80 x1872931145278336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175254.398455:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145278336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175254.398465:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175254.398469:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175254.398473:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145278336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175254.398481:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145278464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175254.398500:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175254.398510:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87f800 x1872931145278464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175254.398525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145278464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175254.398534:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175254.398537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175254.398541:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145278464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175254.398564:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145278592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175254.398583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175254.398595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87dc00 x1872931145278592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175254.398618:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145278592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175254.398628:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175254.398631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175254.398635:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145278592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175254.398642:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145278720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175254.398661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175254.398672:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87c000 x1872931145278720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175254.398686:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145278720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175254.398695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175254.398699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175254.398702:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145278720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175254.398709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145278848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175254.398726:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175254.398737:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87c700 x1872931145278848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175254.398750:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145278848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175254.398768:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175254.398772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175254.398776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145278848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175254.398783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145278976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175254.398801:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175254.398811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175254/real 1786175254]  req@ffff89d99e87c380 x1872931145278976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175254.398824:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145278976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175254.398835:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175254.398838:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175254.398842:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145278976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175254.909128:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175254.909149:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175255.420975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175255.933029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175255.933290:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175256.445060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175256.957042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175256.957109:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175257.469038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175257.981075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175257.981173:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175258.493041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175259.005058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175259.005183:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175259.517007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175259.517048:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.517066:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175259.517075:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175259.517095:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.517116:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175259.517132:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175259.517197:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145279104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175259.517249:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.517257:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175259.517261:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175259.517269:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.517277:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175259.517336:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175259.517354:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175259.517365:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145279104:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175259.517385:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145279232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175259.517405:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.517411:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175259.517413:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175259.517421:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.517428:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175259.517436:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175259.517444:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175259.517461:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145279360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175259.517475:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.517480:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175259.517482:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175259.517487:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.517493:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175259.517498:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175259.517509:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175259.517529:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145279232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175259.517535:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145279488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175259.517561:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.517569:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175259.517573:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145279360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175259.517578:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175259.517592:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.517605:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175259.517614:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145279488:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175259.517618:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175259.517632:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175259.517657:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145279616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175259.517678:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.517684:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175259.517687:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175259.517697:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145279616:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175259.517699:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.517717:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175259.517729:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175259.517741:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175259.517768:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145279744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175259.517807:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.517812:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175259.517815:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175259.517821:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.517829:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175259.517836:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175259.517846:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175259.517855:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145279744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175259.517880:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145279872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175259.517981:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.517989:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175259.517995:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175259.518005:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.518013:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175259.518024:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145279872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175259.518030:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175259.518049:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175259.518080:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145280000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175259.518110:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175259.518117:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175259.518122:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175259.518128:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145280000:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175259.518139:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8993
00000100:00080000:2.0:1786175259.518152:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175259.518161:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175259.518175:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175259.518202:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145280128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175259.518306:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145280128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175260.029036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175260.029133:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175260.541049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175261.052993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175261.053028:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175261.565010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175262.077046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175262.077146:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175262.589003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786175262.589433:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786175262.589484:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786175262.589502:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175262.589560:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786175262.589575:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175262.589585:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175262.589594:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175262.589605:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175262.589618:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175262.589627:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175262.589642:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175262.589667:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87df80 x1872931145280128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.589717:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145280128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.589741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.589751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.589761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145280128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175262.589776:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87f800 x1872931145280000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.589803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145280000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.589821:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.589828:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.589835:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145280000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175262.589848:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87dc00 x1872931145279872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.589872:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145279872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.589887:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.589893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.589954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145279872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175262.589969:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87c000 x1872931145279744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.589998:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145279744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.590018:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.590026:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.590034:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145279744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175262.590047:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87c700 x1872931145279616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.590076:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145279616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.590095:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.590103:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.590110:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145279616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175262.590122:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87c380 x1872931145279488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.590146:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145279488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.590162:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.590168:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.590176:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145279488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175262.590190:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87ed80 x1872931145279232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.590212:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145279232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.590227:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.590233:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.590239:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145279232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175262.590285:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87e680 x1872931145279360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.590310:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145279360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.590325:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.590331:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.590337:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145279360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175262.590349:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175259/real 1786175262]  req@ffff89d99e87ca80 x1872931145279104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175262.590371:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145279104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175262.590386:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175262.590392:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175262.590398:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145279104:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175263.101027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175263.101169:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175263.613001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175264.125018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175264.125131:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175264.637050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175264.637071:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175264.637081:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175264.637087:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175264.637100:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.637115:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175264.637126:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175264.637176:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145280256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175264.637227:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175264.637261:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175264.637265:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175264.637273:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.637280:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175264.637287:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175264.637301:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175264.637329:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145280256:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175264.637333:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145280384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175264.637384:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175264.637391:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175264.637395:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175264.637406:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.637418:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175264.637428:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175264.637441:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175264.637487:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145280512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175264.637503:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175264.637514:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175264.637521:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175264.637524:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175264.637530:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.637537:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175264.637543:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175264.637557:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175264.637588:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145280640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175264.637619:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175264.637628:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe67480 x1872931145280256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175264.637630:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175264.637638:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175264.637655:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.637683:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175264.637692:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175264.637699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145280256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175264.637707:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175264.637735:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175264.637746:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145280768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175264.637751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175264.637771:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145280256:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175264.637781:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175264.637791:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175264.637796:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175264.637806:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.637815:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175264.637821:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145280384:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175264.637831:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175264.637847:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175264.637876:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145280896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175264.637893:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175264.637974:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175264.637977:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe64a80 x1872931145280384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175264.637989:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175264.637997:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175264.638016:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.638028:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175264.638038:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145280384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175264.638043:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175264.638060:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175264.638070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175264.638084:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175264.638095:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145281024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175264.638099:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145280384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175264.638119:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145280512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175264.638163:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175264.638170:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175264.638176:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786175264.638186:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175264.638188:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.638205:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175264.638215:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175264.638227:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175264.638259:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe64700 x1872931145280512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175264.638306:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145280512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175264.638324:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175264.638331:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175264.638336:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145280512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175264.638349:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145280640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175264.638395:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175264.638425:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe65500 x1872931145280640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175264.638452:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145280640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175264.638469:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175264.638475:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175264.638481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145280640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175264.638493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145280768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175264.638530:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175264.638552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe65880 x1872931145280768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175264.638573:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145280768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175264.638597:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175264.638603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175264.638609:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145280768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175264.638648:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145280896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175264.638689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175264.638713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe66300 x1872931145280896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175264.638738:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145280896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175264.638755:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175264.638762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175264.638768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145280896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175264.638782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145281024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175264.638824:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175264.638849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe66a00 x1872931145281024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175264.638872:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145281024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175264.638888:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175264.638894:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175264.638947:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145281024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175264.639513:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145281152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175264.639545:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175264.639552:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175264.639555:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175264.639562:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 8998
00000100:00080000:3.0:1786175264.639581:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175264.639596:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175264.639609:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175264.639617:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145281152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175264.639643:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145281280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175264.639683:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175264.639717:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe67100 x1872931145281152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175264.639745:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145281152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175264.639763:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175264.639769:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175264.639776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145281152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175264.639804:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145281280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175264.639848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175264.639869:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175264/real 1786175264]  req@ffff89d99fe66a00 x1872931145281280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175264.639886:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145281280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175264.639939:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175264.639950:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175264.639958:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145281280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175265.149038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175265.149109:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175265.661030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175266.173035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175266.173188:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175266.685026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175267.197029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175267.197192:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175267.645103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175267.645117:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175267.645124:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175267.645139:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9003
00000100:00080000:0.0:1786175267.645154:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175267.645165:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175267.645269:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145281408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175267.645309:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175267.645315:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175267.645317:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175267.645321:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9003
00000100:00080000:0.0:1786175267.645326:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175267.645330:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175267.645345:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175267.645366:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145281536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175267.645380:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175267.645385:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175267.645387:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175267.645397:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9003
00000100:00100000:1.0:1786175267.645397:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145281408:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175267.645403:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175267.645411:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175267.645419:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175267.645431:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145281664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175267.645440:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175267.645444:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175267.645446:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175267.645450:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9003
00000100:00080000:0.0:1786175267.645452:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175267.645456:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175267.645462:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175267.645490:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145281792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175267.645507:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175267.645513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175267.645516:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175267.645523:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9003
00000100:00080000:0.0:1786175267.645542:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175267.645549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175267.645559:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175267.645560:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175267.645587:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145281920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175267.645605:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175267.645611:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175267.645615:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175267.645622:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9003
00000100:00080000:0.0:1786175267.645628:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175267.645635:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175267.645645:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175267.645670:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f0700 x1872931145281408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175267.645672:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145282048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175267.645728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175267.645734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175267.645739:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175267.645743:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145281408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175267.645752:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9003
00000100:00080000:0.0:1786175267.645765:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175267.645776:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175267.645777:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175267.645791:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175267.645793:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175267.645807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145281408:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175267.645822:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145282176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175267.645839:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175267.645845:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175267.645848:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175267.645857:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145281536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175267.645863:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9003
00000100:00080000:0.0:1786175267.645874:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175267.645882:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175267.645892:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175267.645956:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175267.645985:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f1500 x1872931145281536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175267.646002:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145282304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175267.646027:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175267.646030:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145281536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175267.646038:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175267.646045:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175267.646060:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9004
00000100:00080000:1.0:1786175267.646062:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175267.646072:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175267.646076:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175267.646085:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175267.646091:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145281536:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175267.646100:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175267.646107:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145281664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175267.646128:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145282432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175267.646162:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175267.646189:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f2680 x1872931145281664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175267.646246:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145281664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175267.646261:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175267.646266:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175267.646271:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145281664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175267.646282:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145281792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175267.646318:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175267.646338:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f3b80 x1872931145281792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175267.646359:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145281792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175267.646371:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175267.646377:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175267.646382:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145281792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175267.646391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145281920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175267.646421:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175267.646438:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f3480 x1872931145281920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175267.646455:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145281920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175267.646477:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175267.646481:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175267.646486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145281920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175267.646494:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145282048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175267.646524:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175267.646541:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f2d80 x1872931145282048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175267.646560:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145282048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175267.646572:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175267.646578:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175267.646582:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145282048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175267.646591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145282176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175267.646620:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175267.646638:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f2a00 x1872931145282176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175267.646654:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145282176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175267.646664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175267.646668:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175267.646674:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145282176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175267.646714:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145282304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175267.646745:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175267.646762:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f0e00 x1872931145282304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175267.646780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145282304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175267.646795:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175267.646800:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175267.646806:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145282304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175267.646816:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145282432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175267.646846:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175267.646866:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175267/real 1786175267]  req@ffff89d9870f1880 x1872931145282432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175267.646885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145282432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175267.646942:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175267.646950:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175267.646956:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145282432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175267.709070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175268.220997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175268.221072:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175268.733011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175269.244989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175269.245052:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175269.757047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175270.269031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175270.269111:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175270.781015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175271.293025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175271.293105:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175271.805026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175272.317054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175272.317116:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175272.828989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175272.829057:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175272.829067:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175272.829071:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175272.829081:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00080000:3.0:1786175272.829091:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175272.829099:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175272.829139:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145282560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175272.829238:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175272.829242:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175272.829244:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175272.829249:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00080000:3.0:1786175272.829253:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175272.829258:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175272.829270:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175272.829288:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145282560:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175272.829289:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145282688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175272.829311:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175272.829314:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175272.829316:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175272.829321:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00080000:3.0:1786175272.829324:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175272.829327:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175272.829334:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175272.829347:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145282816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175272.829357:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175272.829361:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175272.829363:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175272.829367:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00080000:3.0:1786175272.829372:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786175272.829373:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175272.829382:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175272.829390:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175272.829403:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145282944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175272.829413:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175272.829418:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175272.829420:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175272.829428:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00100000:1.0:1786175272.829430:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe66300 x1872931145282560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175272.829432:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175272.829442:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175272.829453:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175272.829472:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145282560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175272.829474:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145283072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175272.829521:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175272.829521:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175272.829532:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175272.829534:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175272.829536:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175272.829546:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145282560:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175272.829547:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00080000:3.0:1786175272.829557:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175272.829564:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175272.829569:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175272.829578:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145283200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175272.829586:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145282688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175272.829598:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175272.829603:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175272.829605:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175272.829611:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00080000:3.0:1786175272.829616:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175272.829621:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175272.829626:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175272.829632:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175272.829647:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe65880 x1872931145282688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175272.829651:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145283328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175272.829708:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175272.829713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145282688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175272.829715:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175272.829724:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175272.829742:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00080000:1.0:1786175272.829746:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175272.829749:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175272.829754:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175272.829759:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175272.829774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175272.829777:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145283456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175272.829788:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145282688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175272.829811:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175272.829815:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145282816:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175272.829819:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175272.829827:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175272.829835:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9007
00000100:00080000:3.0:1786175272.829840:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175272.829845:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175272.829853:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175272.829881:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175272.829889:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145283584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175272.829900:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe65500 x1872931145282816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175272.829944:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145282816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175272.829954:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175272.829957:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175272.829960:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145282816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175272.829967:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145282944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175272.829990:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175272.830001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe64700 x1872931145282944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175272.830012:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145282944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175272.830020:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175272.830023:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175272.830026:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145282944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175272.830032:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145283072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175272.830047:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175272.830055:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe64a80 x1872931145283072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175272.830076:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145283072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175272.830089:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175272.830094:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175272.830099:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145283072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175272.830127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145283200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175272.830184:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175272.830198:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe67480 x1872931145283200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175272.830212:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145283200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175272.830220:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175272.830224:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175272.830227:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145283200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175272.830233:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145283328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175272.830251:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175272.830261:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe64000 x1872931145283328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175272.830272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145283328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175272.830286:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175272.830289:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175272.830292:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145283328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175272.830298:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145283456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175272.830312:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175272.830320:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe65f80 x1872931145283456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175272.830331:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145283456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175272.830339:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175272.830342:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175272.830345:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145283456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175272.830350:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145283584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175272.830365:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175272.830373:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175272/real 1786175272]  req@ffff89d99fe67b80 x1872931145283584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175272.830384:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145283584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175272.830392:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175272.830395:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175272.830398:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145283584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175273.341030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175273.341193:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175273.853018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175274.365059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175274.365159:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175274.877013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175275.389090:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175275.389156:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175275.901067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175276.413050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175276.413153:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175276.925062:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175277.437022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175277.437127:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175277.949012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175277.949019:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175277.949030:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175277.949037:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175277.949050:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00080000:3.0:1786175277.949063:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175277.949074:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175277.949144:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145283712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175277.949179:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175277.949185:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175277.949188:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175277.949193:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00080000:3.0:1786175277.949198:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175277.949203:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175277.949217:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175277.949235:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145283840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175277.949243:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145283712:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175277.949258:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175277.949264:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175277.949266:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175277.949272:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00080000:3.0:1786175277.949276:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175277.949281:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175277.949287:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175277.949303:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145283968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175277.949315:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175277.949320:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175277.949323:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175277.949327:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00080000:3.0:1786175277.949332:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175277.949340:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175277.949343:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175277.949349:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175277.949370:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145284096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175277.949382:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175277.949386:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175277.949389:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175277.949396:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00080000:3.0:1786175277.949402:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175277.949407:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe65180 x1872931145283712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175277.949412:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175277.949425:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175277.949450:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145284224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175277.949455:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145283712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175277.949492:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175277.949499:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175277.949500:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175277.949508:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175277.949515:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175277.949523:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00100000:1.0:1786175277.949530:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145283712:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175277.949533:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175277.949547:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175277.949553:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175277.949567:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145284352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175277.949575:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145283840:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175277.949592:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175277.949609:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175277.949613:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786175277.949617:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175277.949625:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00080000:3.0:1786175277.949635:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175277.949641:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175277.949649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe64380 x1872931145283840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175277.949650:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175277.949676:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145284480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175277.949682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145283840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175277.949718:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175277.949723:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175277.949725:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175277.949733:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175277.949738:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175277.949746:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00100000:1.0:1786175277.949754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145283840:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175277.949757:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175277.949770:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175277.949777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145283968:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175277.949782:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175277.949803:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145284608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175277.949818:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175277.949819:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175277.949828:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175277.949831:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175277.949840:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9012
00000100:00100000:1.0:1786175277.949845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe66d80 x1872931145283968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175277.949848:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175277.949862:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175277.949875:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175277.949887:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145283968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175277.949896:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145284736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175277.949941:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175277.949957:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175277.949971:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145283968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175277.949989:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145284096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175277.950020:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175277.950034:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe66680 x1872931145284096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175277.950050:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145284096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175277.950060:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175277.950064:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175277.950067:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145284096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175277.950074:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145284224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175277.950092:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175277.950130:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe67800 x1872931145284224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175277.950146:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145284224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175277.950155:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175277.950159:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175277.950163:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145284224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175277.950186:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145284352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175277.950209:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175277.950222:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe65180 x1872931145284352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175277.950236:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145284352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175277.950246:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175277.950249:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175277.950252:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145284352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175277.950259:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145284480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175277.950277:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175277.950288:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe67b80 x1872931145284480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175277.950301:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145284480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175277.950312:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175277.950315:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175277.950319:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145284480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175277.950326:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145284608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175277.950342:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175277.950353:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe65f80 x1872931145284608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175277.950366:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145284608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175277.950377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175277.950380:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175277.950383:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145284608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175277.950389:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145284736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175277.950406:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175277.950416:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175277/real 1786175277]  req@ffff89d99fe64000 x1872931145284736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175277.950430:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145284736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175277.950439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175277.950442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175277.950447:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145284736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175278.461077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175278.461129:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175278.973164:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175279.484955:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175279.485102:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175279.997009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175280.509027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175280.509162:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175281.021026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175281.533043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175281.533161:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175282.045005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175282.557093:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175282.557145:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175283.069104:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175283.069168:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175283.069177:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175283.069183:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175283.069195:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00080000:0.0:1786175283.069207:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175283.069217:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175283.069262:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145284864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175283.069301:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175283.069306:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175283.069309:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175283.069314:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00080000:0.0:1786175283.069318:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175283.069322:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175283.069333:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175283.069347:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145284992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175283.069361:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175283.069366:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175283.069370:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175283.069375:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00080000:0.0:1786175283.069379:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175283.069389:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175283.069391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145284864:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786175283.069395:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175283.069416:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145285120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175283.069429:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175283.069433:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175283.069436:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175283.069441:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00080000:0.0:1786175283.069446:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175283.069450:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175283.069457:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175283.069472:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145285248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175283.069483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786175283.069489:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175283.069492:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175283.069497:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175283.069505:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00080000:0.0:1786175283.069512:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175283.069516:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175283.069521:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175283.069538:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145285376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175283.069549:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175283.069554:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175283.069557:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175283.069563:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00100000:1.0:1786175283.069570:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f3100 x1872931145284864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175283.069572:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175283.069587:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175283.069599:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175283.069615:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145284864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175283.069619:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145285504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175283.069664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175283.069665:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175283.069677:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175283.069680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175283.069682:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175283.069692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145284864:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175283.069695:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00080000:0.0:1786175283.069707:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175283.069713:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145284992:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175283.069719:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175283.069727:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175283.069745:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145285632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175283.069756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175283.069762:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175283.069767:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786175283.069769:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175283.069777:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00080000:0.0:1786175283.069786:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175283.069793:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175283.069799:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175283.069813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f0a80 x1872931145284992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175283.069817:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145285760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175283.069884:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175283.069889:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175283.069891:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175283.069927:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145284992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175283.069945:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175283.069952:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175283.069959:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145284992:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175283.069971:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9017
00000100:00080000:0.0:1786175283.069979:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175283.069985:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175283.069992:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175283.070004:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145285120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175283.070015:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145285888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175283.070080:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175283.070117:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f1180 x1872931145285120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175283.070136:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145285120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175283.070147:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175283.070152:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175283.070156:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145285120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175283.070164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145285248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175283.070191:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175283.070204:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f1880 x1872931145285248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175283.070218:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145285248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175283.070228:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175283.070231:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175283.070234:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145285248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175283.070241:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145285376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175283.070260:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175283.070271:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f0e00 x1872931145285376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175283.070285:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145285376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175283.070295:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175283.070298:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175283.070302:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145285376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175283.070308:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145285504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175283.070326:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175283.070337:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f2a00 x1872931145285504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175283.070351:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145285504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175283.070360:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175283.070364:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175283.070367:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145285504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175283.070373:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145285632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175283.070391:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175283.070402:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f2d80 x1872931145285632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175283.070415:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145285632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175283.070425:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175283.070429:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175283.070433:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145285632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175283.070439:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145285760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175283.070456:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175283.070467:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f3480 x1872931145285760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175283.070480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145285760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175283.070489:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175283.070493:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175283.070497:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145285760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175283.070521:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145285888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175283.070541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175283.070552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175283/real 1786175283]  req@ffff89d9870f3b80 x1872931145285888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175283.070567:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145285888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175283.070576:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175283.070580:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175283.070584:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145285888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175283.581037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175283.581184:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175284.093006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175284.605031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175284.605177:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175285.117024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175285.629124:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175285.629196:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175286.141132:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175286.652974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175286.653028:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175287.164980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175287.676975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175287.677056:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175288.188986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175288.189016:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175288.189021:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175288.189025:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175288.189033:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189041:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175288.189047:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175288.189080:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145286016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175288.189102:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175288.189105:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175288.189106:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175288.189109:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189111:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175288.189115:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175288.189122:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175288.189131:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145286144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175288.189138:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145286016:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175288.189141:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175288.189146:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175288.189147:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175288.189151:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189152:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175288.189154:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175288.189158:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175288.189166:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145286272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175288.189179:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175288.189181:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175288.189183:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175288.189185:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189188:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175288.189191:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175288.189194:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175288.189198:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175288.189206:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145286400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175288.189214:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175288.189216:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175288.189217:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175288.189220:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189223:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175288.189226:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175288.189229:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175288.189234:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe67480 x1872931145286016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175288.189238:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145286528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175288.189261:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175288.189263:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175288.189265:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175288.189269:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145286016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175288.189272:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189279:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175288.189283:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175288.189286:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175288.189289:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175288.189294:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145286016:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175288.189302:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175288.189313:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145286144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175288.189318:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145286656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175288.189331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175288.189332:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175288.189337:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175288.189340:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175288.189342:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe64a80 x1872931145286144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175288.189346:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189352:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175288.189359:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175288.189360:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145286144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175288.189365:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175288.189371:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175288.189375:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175288.189380:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145286784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175288.189381:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145286144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175288.189392:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145286272:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175288.189396:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175288.189399:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175288.189401:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175288.189405:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189408:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786175288.189411:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175288.189413:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175288.189418:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175288.189423:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe64700 x1872931145286272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175288.189428:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145286912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175288.189438:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175288.189440:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145286272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175288.189441:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175288.189444:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175288.189450:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9022
00000100:00080000:3.0:1786175288.189454:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175288.189459:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175288.189462:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175288.189469:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145287040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175288.189471:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175288.189481:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175288.189486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145286272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175288.189494:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145286400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175288.189512:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175288.189520:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe65500 x1872931145286400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175288.189542:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145286400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175288.189551:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175288.189554:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175288.189558:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145286400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175288.189565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145286528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175288.189583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175288.189591:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe65880 x1872931145286528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175288.189600:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145286528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175288.189605:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175288.189607:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175288.189609:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145286528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175288.189627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145286656:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175288.189646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175288.189658:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe66300 x1872931145286656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175288.189671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145286656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175288.189676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175288.189679:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175288.189681:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145286656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175288.189685:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145286784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175288.189698:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175288.189705:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe66a00 x1872931145286784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175288.189712:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145286784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175288.189717:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175288.189719:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175288.189721:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145286784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175288.189724:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145286912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175288.189734:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175288.189739:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe67100 x1872931145286912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175288.189746:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145286912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175288.189752:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175288.189753:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175288.189755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145286912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175288.189758:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145287040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175288.189767:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175288.189772:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175288/real 1786175288]  req@ffff89d99fe67480 x1872931145287040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175288.189779:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145287040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175288.189784:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175288.189786:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175288.189788:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145287040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175288.700979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175288.701033:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175289.213015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175289.725037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175289.725050:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175290.237004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175290.749068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175290.749201:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175291.261082:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175291.773070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175291.773229:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175292.285072:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175292.797099:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175292.797146:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175293.309089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175293.309102:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309113:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175293.309120:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309133:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9027
00000100:00080000:2.0:1786175293.309149:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309160:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175293.309211:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145287168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175293.309256:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309263:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175293.309267:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309276:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9027
00000100:00080000:2.0:1786175293.309281:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309288:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175293.309301:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175293.309317:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145287168:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175293.309328:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145287296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175293.309357:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309362:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175293.309366:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309372:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9027
00000100:00080000:2.0:1786175293.309394:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309400:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175293.309410:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175293.309429:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145287424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175293.309443:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309448:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175293.309450:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309454:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9027
00000100:00080000:2.0:1786175293.309459:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309464:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175293.309471:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175293.309486:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145287552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175293.309499:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309503:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175293.309506:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309518:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9027
00000800:00000100:3.0:1786175293.309518:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175293.309529:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309534:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175293.309541:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175293.309554:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145287680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175293.309565:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309570:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175293.309573:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309583:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9027
00000100:00100000:3.0:1786175293.309585:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87ca80 x1872931145287168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175293.309588:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309602:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175293.309616:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175293.309640:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145287168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175293.309641:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145287808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175293.309687:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309692:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175293.309694:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309698:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9027
00000100:00080000:2.0:1786175293.309701:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309705:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175293.309709:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175293.309718:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145287936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175293.309738:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309741:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175293.309744:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309749:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9027
00000100:00080000:2.0:1786175293.309752:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309756:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175293.309761:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175293.309775:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145288064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175293.309785:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175293.309790:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175293.309793:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175293.309798:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9027
00000100:00080000:2.0:1786175293.309801:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175293.309805:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175293.309809:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175293.309824:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145288192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175293.309854:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.309864:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.309874:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145287168:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175293.310032:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145287296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175293.310072:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175293.310091:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87e680 x1872931145287296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175293.310109:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145287296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175293.310120:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.310124:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.310128:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145287296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175293.310136:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145287424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175293.310158:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175293.310169:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87ed80 x1872931145287424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175293.310192:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145287424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175293.310203:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.310206:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.310210:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145287424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175293.310216:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145287552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175293.310236:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175293.310247:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87c380 x1872931145287552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175293.310261:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145287552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175293.310271:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.310274:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.310278:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145287552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175293.310284:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145287680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175293.310304:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175293.310315:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87c700 x1872931145287680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175293.310329:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145287680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175293.310347:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.310351:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.310355:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145287680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175293.310361:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145287808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175293.310379:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175293.310389:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87c000 x1872931145287808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175293.310403:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145287808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175293.310413:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.310416:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.310420:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145287808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175293.310426:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145287936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175293.310444:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175293.310455:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87dc00 x1872931145287936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175293.310469:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145287936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175293.310478:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.310482:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.310486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145287936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175293.310493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145288064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175293.310511:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175293.310522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87f800 x1872931145288064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175293.310535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145288064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175293.310545:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.310548:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.310552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145288064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175293.310558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145288192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175293.310575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175293.310585:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175293/real 1786175293]  req@ffff89d99e87df80 x1872931145288192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175293.310599:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145288192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175293.310609:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175293.310612:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175293.310616:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145288192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175293.821054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175293.821065:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175294.332990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175294.844990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175294.845046:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175295.357047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175295.869081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175295.869205:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175296.381033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175296.893067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175296.893137:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175297.405086:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175297.917034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175297.917147:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175298.429085:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175298.429103:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175298.429111:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175298.429117:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175298.429131:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9032
00000100:00080000:2.0:1786175298.429150:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175298.429166:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175298.429224:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145288320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175298.429263:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175298.429269:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175298.429272:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175298.429277:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9032
00000100:00080000:2.0:1786175298.429283:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175298.429289:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175298.429303:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175298.429322:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145288320:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175298.429324:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145288448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175298.429350:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175298.429354:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175298.429356:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175298.429362:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9032
00000100:00080000:2.0:1786175298.429366:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175298.429370:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175298.429377:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175298.429392:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145288576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175298.429405:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175298.429411:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175298.429413:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175298.429417:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9032
00000100:00080000:2.0:1786175298.429422:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175298.429426:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175298.429432:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175298.429434:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175298.429455:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145288704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175298.429468:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175298.429472:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175298.429475:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175298.429481:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9032
00000100:00080000:2.0:1786175298.429485:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175298.429496:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175298.429497:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87f100 x1872931145288320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175298.429502:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175298.429522:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145288832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175298.429536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145288320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175298.429537:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175298.429555:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175298.429561:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175298.429576:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9032
00000100:00080000:3.0:1786175298.429580:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175298.429582:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175298.429594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175298.429596:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175298.429607:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175298.429608:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145288320:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175298.429627:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145288960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175298.429641:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175298.429645:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:3.0:1786175298.429652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145288448:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175298.429653:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175298.429670:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9032
00000100:00080000:2.0:1786175298.429677:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175298.429681:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175298.429689:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175298.429704:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175298.429710:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145289088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175298.429728:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175298.429730:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87d500 x1872931145288448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175298.429738:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175298.429745:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175298.429760:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9032
00000100:00080000:2.0:1786175298.429771:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175298.429778:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145288448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175298.429781:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175298.429795:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175298.429804:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175298.429813:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145289216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175298.429815:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175298.429827:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145288448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175298.429849:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145288576:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175298.429851:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175298.429868:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175298.429874:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175298.429881:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9032
00000800:00000100:3.0:1786175298.429947:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175298.429968:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175298.429970:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87d880 x1872931145288576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175298.429984:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175298.430003:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175298.430009:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145288576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175298.430025:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175298.430030:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145289344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175298.430036:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175298.430051:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145288576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175298.430072:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145288704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175298.430105:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175298.430119:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87df80 x1872931145288704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175298.430133:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145288704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175298.430142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175298.430146:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175298.430149:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145288704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175298.430156:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145288832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175298.430175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175298.430186:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87f800 x1872931145288832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175298.430209:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145288832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175298.430218:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175298.430221:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175298.430225:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145288832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175298.430231:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145288960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175298.430249:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175298.430260:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87dc00 x1872931145288960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175298.430273:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145288960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175298.430283:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175298.430287:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175298.430290:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145288960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175298.430312:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145289088:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175298.430331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175298.430342:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87c000 x1872931145289088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175298.430356:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145289088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175298.430374:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175298.430377:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175298.430381:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145289088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175298.430388:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145289216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175298.430405:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175298.430415:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87c700 x1872931145289216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175298.430429:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145289216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175298.430439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175298.430442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175298.430446:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145289216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175298.430452:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145289344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175298.430469:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175298.430480:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175298/real 1786175298]  req@ffff89d99e87c380 x1872931145289344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175298.430494:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145289344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175298.430503:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175298.430506:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175298.430511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145289344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175298.941066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175298.941170:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175299.453034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175299.964977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175299.965114:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175300.476974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175300.989011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175300.989096:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175301.500996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175302.012983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175302.013061:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175302.524994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175303.037069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175303.037079:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175303.549020:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175303.549023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175303.549039:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175303.549043:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175303.549056:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00080000:2.0:1786175303.549068:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175303.549076:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175303.549131:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145289472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175303.549162:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175303.549165:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175303.549167:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175303.549170:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00080000:2.0:1786175303.549173:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175303.549177:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175303.549187:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175303.549200:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145289600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175303.549205:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145289472:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175303.549227:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175303.549229:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175303.549231:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175303.549237:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00080000:2.0:1786175303.549241:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175303.549244:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175303.549252:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175303.549264:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145289728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175303.549271:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175303.549274:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175303.549276:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175303.549278:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00080000:2.0:1786175303.549280:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175303.549284:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175303.549289:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175303.549290:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175303.549313:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145289856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175303.549329:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175303.549333:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175303.549338:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175303.549338:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87ed80 x1872931145289472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175303.549356:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00080000:2.0:1786175303.549363:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175303.549366:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145289472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175303.549372:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175303.549384:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175303.549388:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175303.549394:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175303.549402:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145289472:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175303.549405:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145289984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175303.549421:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175303.549431:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175303.549434:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175303.549439:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145289600:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175303.549444:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00080000:2.0:1786175303.549450:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175303.549453:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175303.549458:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175303.549475:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145290112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175303.549486:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175303.549492:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175303.549502:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175303.549504:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175303.549513:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00100000:3.0:1786175303.549514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87e680 x1872931145289600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175303.549520:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175303.549534:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175303.549544:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175303.549554:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145289600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175303.549555:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145290240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175303.549602:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175303.549621:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175303.549629:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175303.549632:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175303.549637:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00080000:2.0:1786175303.549643:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175303.549643:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175303.549661:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175303.549662:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145289600:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175303.549681:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175303.549684:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145289728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175303.549705:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145290368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175303.549717:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175303.549728:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175303.549736:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786175303.549738:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87ca80 x1872931145289728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175303.549739:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175303.549746:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9037
00000100:00080000:2.0:1786175303.549753:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175303.549761:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175303.549772:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175303.549783:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145289728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175303.549785:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145290496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175303.549798:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175303.549807:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175303.549814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145289728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175303.549821:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145289856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175303.549842:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175303.549851:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87c380 x1872931145289856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175303.549887:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145289856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175303.549893:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175303.549916:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175303.549918:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145289856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175303.549923:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145289984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175303.549940:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175303.549948:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87c700 x1872931145289984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175303.549961:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145289984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175303.549966:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175303.549968:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175303.549970:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145289984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175303.549983:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145290112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175303.549995:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175303.550001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87c000 x1872931145290112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175303.550009:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145290112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175303.550014:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175303.550016:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175303.550018:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145290112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175303.550022:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145290240:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175303.550032:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175303.550037:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87dc00 x1872931145290240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175303.550044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145290240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175303.550053:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175303.550055:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175303.550057:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145290240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175303.550061:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145290368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175303.550070:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175303.550076:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87f800 x1872931145290368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175303.550082:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145290368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175303.550088:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175303.550090:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175303.550092:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145290368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175303.550095:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145290496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175303.550104:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175303.550110:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175303/real 1786175303]  req@ffff89d99e87df80 x1872931145290496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175303.550117:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145290496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175303.550122:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175303.550125:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175303.550129:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145290496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175304.061001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175304.061057:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175304.573014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175305.084993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175305.085052:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175305.596999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175306.108980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175306.109037:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175306.620966:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175307.132969:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175307.133003:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175307.645011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175308.156983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175308.157077:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175308.668980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175308.669011:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175308.669016:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175308.669020:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669029:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00080000:0.0:1786175308.669037:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669043:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175308.669076:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145290624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175308.669095:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175308.669097:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175308.669099:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669101:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00080000:0.0:1786175308.669103:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669106:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175308.669113:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175308.669122:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145290752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175308.669130:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175308.669132:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175308.669133:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669139:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00100000:3.0:1786175308.669139:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145290624:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175308.669144:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669150:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175308.669154:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175308.669162:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145290880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175308.669168:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175308.669170:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175308.669171:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669174:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00080000:0.0:1786175308.669176:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669178:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175308.669181:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175308.669189:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145291008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175308.669195:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175308.669197:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175308.669198:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669201:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00080000:0.0:1786175308.669203:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669206:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175308.669212:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175308.669212:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175308.669224:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145291136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175308.669231:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175308.669233:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175308.669235:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669237:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00080000:0.0:1786175308.669239:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669242:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175308.669244:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175308.669253:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145291264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175308.669260:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f2680 x1872931145290624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175308.669261:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175308.669266:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175308.669269:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669277:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00080000:0.0:1786175308.669281:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669286:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175308.669290:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175308.669297:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145290624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175308.669299:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145291392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175308.669329:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175308.669332:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175308.669333:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175308.669334:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669343:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00080000:3.0:1786175308.669343:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175308.669349:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669355:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175308.669355:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145290624:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786175308.669361:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175308.669370:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145291520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175308.669382:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175308.669384:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145290752:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175308.669388:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175308.669393:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175308.669398:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9042
00000100:00080000:0.0:1786175308.669403:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175308.669409:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175308.669415:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175308.669415:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175308.669435:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145291648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175308.669436:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f1500 x1872931145290752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175308.669471:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145290752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175308.669482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175308.669486:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175308.669490:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145290752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175308.669496:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145290880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175308.669515:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175308.669525:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f0700 x1872931145290880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175308.669538:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145290880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175308.669547:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175308.669550:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175308.669553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145290880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175308.669559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145291008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175308.669575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175308.669584:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f3b80 x1872931145291008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175308.669596:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145291008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175308.669604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175308.669608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175308.669611:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145291008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175308.669617:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145291136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175308.669632:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175308.669642:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f3480 x1872931145291136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175308.669661:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145291136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175308.669669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175308.669672:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175308.669675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145291136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175308.669682:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145291264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175308.669697:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175308.669706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f2d80 x1872931145291264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175308.669719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145291264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175308.669728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175308.669731:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175308.669734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145291264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175308.669739:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145291392:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175308.669754:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175308.669763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f2a00 x1872931145291392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175308.669774:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145291392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175308.669789:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175308.669793:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175308.669796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145291392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175308.669847:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145291520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175308.669866:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175308.669876:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f0e00 x1872931145291520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175308.669888:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145291520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175308.669919:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175308.669923:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175308.669926:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145291520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175308.669933:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145291648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175308.669959:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175308.669969:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175308/real 1786175308]  req@ffff89d9870f1880 x1872931145291648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175308.669981:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145291648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175308.669989:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175308.669992:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175308.669996:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145291648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175309.180970:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175309.181027:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175309.692989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175310.204992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175310.205047:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175310.716976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175311.228986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175311.229025:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175311.741002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175312.252995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175312.253049:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175312.764984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175313.277005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175313.277062:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175313.788994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175313.789002:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175313.789008:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175313.789011:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175313.789020:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00080000:3.0:1786175313.789029:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175313.789036:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175313.789068:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145291776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175313.789102:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175313.789105:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175313.789106:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175313.789109:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00080000:3.0:1786175313.789112:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175313.789114:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175313.789121:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175313.789130:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145291904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175313.789138:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175313.789142:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145291776:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175313.789143:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175313.789146:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175313.789154:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00080000:3.0:1786175313.789156:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175313.789159:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175313.789162:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175313.789171:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145292032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175313.789177:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175313.789180:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175313.789181:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175313.789184:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00080000:3.0:1786175313.789186:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175313.789189:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175313.789193:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175313.789200:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145292160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175313.789212:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786175313.789217:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175313.789218:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175313.789221:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175313.789225:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00080000:3.0:1786175313.789228:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175313.789231:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175313.789234:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175313.789240:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145292288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175313.789245:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175313.789248:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175313.789250:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175313.789253:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00080000:3.0:1786175313.789256:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175313.789257:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe64000 x1872931145291776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175313.789262:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175313.789269:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175313.789282:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145292416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175313.789292:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145291776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175313.789311:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175313.789315:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175313.789315:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175313.789317:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175313.789321:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175313.789322:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00080000:3.0:1786175313.789327:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175313.789330:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145291776:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175313.789333:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175313.789339:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175313.789346:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145292544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175313.789354:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175313.789358:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145291904:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175313.789359:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175313.789362:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175313.789367:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00080000:3.0:1786175313.789369:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175313.789372:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175313.789376:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175313.789380:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175313.789385:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145292672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175313.789394:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175313.789396:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175313.789398:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175313.789401:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9048
00000100:00100000:1.0:1786175313.789405:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe65f80 x1872931145291904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175313.789406:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175313.789415:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175313.789422:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145291904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175313.789423:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175313.789439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175313.789442:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145292800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175313.789444:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175313.789450:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145291904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175313.789460:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145292032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175313.789477:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175313.789486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe67b80 x1872931145292032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175313.789493:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145292032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175313.789499:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175313.789500:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175313.789502:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145292032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175313.789506:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145292160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175313.789517:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175313.789522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe65180 x1872931145292160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175313.789530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145292160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175313.789534:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175313.789536:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175313.789538:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145292160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175313.789541:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145292288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175313.789551:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175313.789556:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe67800 x1872931145292288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175313.789562:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145292288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175313.789567:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175313.789568:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175313.789570:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145292288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175313.789573:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145292416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175313.789583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175313.789588:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe66680 x1872931145292416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175313.789595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145292416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175313.789600:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175313.789602:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175313.789604:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145292416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175313.789616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145292544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175313.789626:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175313.789632:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe66d80 x1872931145292544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175313.789639:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145292544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175313.789644:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175313.789646:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175313.789647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145292544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175313.789651:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145292672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175313.789671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175313.789676:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe64380 x1872931145292672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175313.789683:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145292672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175313.789688:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175313.789690:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175313.789692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145292672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175313.789695:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145292800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175313.789704:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175313.789709:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175313/real 1786175313]  req@ffff89d99fe64000 x1872931145292800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175313.789716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145292800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175313.789722:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175313.789724:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175313.789726:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145292800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175314.300986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175314.301063:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175314.813000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175315.325018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175315.325129:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175315.836994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175316.349027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175316.349110:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175316.861008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175317.373029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175317.373143:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175317.884984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175318.397023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175318.397069:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175318.908979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175318.909037:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175318.909045:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175318.909049:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175318.909059:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:0.0:1786175318.909069:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175318.909077:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175318.909117:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145292928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175318.909147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175318.909152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175318.909154:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175318.909159:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:0.0:1786175318.909163:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175318.909168:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175318.909178:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175318.909183:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145292928:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175318.909191:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145293056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175318.909200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175318.909203:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175318.909205:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175318.909208:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:0.0:1786175318.909211:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175318.909213:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175318.909217:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175318.909227:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145293184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175318.909233:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175318.909235:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175318.909237:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175318.909239:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:0.0:1786175318.909242:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175318.909245:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175318.909249:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175318.909253:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175318.909260:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145293312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175318.909268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175318.909270:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175318.909272:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175318.909275:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:0.0:1786175318.909277:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175318.909279:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175318.909282:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175318.909292:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145293440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175318.909298:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f1180 x1872931145292928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175318.909299:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175318.909306:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175318.909309:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175318.909316:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:0.0:1786175318.909319:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175318.909322:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175318.909326:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145292928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175318.909327:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175318.909338:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145293568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175318.909341:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175318.909350:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175318.909358:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145292928:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175318.909361:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175318.909365:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175318.909366:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175318.909370:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:0.0:1786175318.909372:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175318.909374:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175318.909377:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175318.909381:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145293056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175318.909387:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145293696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175318.909395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175318.909398:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175318.909399:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175318.909402:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:0.0:1786175318.909405:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786175318.909406:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175318.909410:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175318.909416:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175318.909424:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f0a80 x1872931145293056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175318.909427:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145293824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175318.909456:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175318.909460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145293056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175318.909463:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175318.909467:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175318.909473:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175318.909477:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9053
00000100:00080000:1.0:1786175318.909480:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175318.909485:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175318.909486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145293056:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175318.909496:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175318.909497:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145293184:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175318.909507:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175318.909521:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175318.909524:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145293952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175318.909539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f3100 x1872931145293184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175318.909555:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145293184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175318.909564:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175318.909567:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175318.909571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145293184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175318.909577:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145293312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175318.909609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175318.909618:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f1880 x1872931145293312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175318.909626:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145293312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175318.909632:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175318.909634:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175318.909636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145293312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175318.909640:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145293440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175318.909650:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175318.909656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f0e00 x1872931145293440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175318.909663:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145293440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175318.909668:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175318.909670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175318.909671:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145293440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175318.909675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145293568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175318.909684:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175318.909690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f2a00 x1872931145293568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175318.909697:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145293568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175318.909702:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175318.909721:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175318.909725:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145293568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175318.909741:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145293696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175318.909756:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175318.909763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f2d80 x1872931145293696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175318.909771:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145293696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175318.909776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175318.909778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175318.909780:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145293696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175318.909784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145293824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175318.909793:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175318.909799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f3480 x1872931145293824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175318.909806:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145293824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175318.909811:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175318.909813:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175318.909815:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145293824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175318.909818:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145293952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175318.909827:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175318.909833:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175318/real 1786175318]  req@ffff89d9870f3b80 x1872931145293952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175318.909840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145293952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175318.909845:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175318.909847:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175318.909849:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145293952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175319.420994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175319.421062:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175319.933001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175320.445015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175320.445048:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175320.956995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175321.468965:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175321.469059:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175321.981003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175322.493024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175322.493067:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175323.005036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175323.517066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175323.517162:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175324.029072:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175324.029079:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175324.029095:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175324.029103:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175324.029119:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029146:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175324.029158:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175324.029223:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145294080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175324.029273:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175324.029281:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175324.029285:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175324.029293:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029301:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175324.029309:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175324.029322:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175324.029332:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145294080:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175324.029348:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145294208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175324.029367:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175324.029371:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175324.029374:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175324.029380:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029384:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175324.029390:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175324.029396:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175324.029411:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145294336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175324.029424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175324.029429:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175324.029432:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175324.029438:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029442:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175324.029448:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175324.029455:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175324.029471:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145294464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175324.029480:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145294208:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175324.029505:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175324.029511:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175324.029515:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175324.029522:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029529:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175324.029539:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175324.029540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145294336:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175324.029549:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175324.029576:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145294592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175324.029592:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175324.029598:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145294464:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175324.029602:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175324.029611:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175324.029620:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029625:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175324.029632:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175324.029641:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175324.029651:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145294592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175324.029692:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145294720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175324.029709:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175324.029715:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175324.029718:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175324.029723:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145294720:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175324.029731:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029748:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175324.029758:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175324.029768:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175324.029800:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145294848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175324.029816:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175324.029822:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175324.029825:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175324.029832:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029838:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175324.029845:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145294848:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175324.029850:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175324.029863:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175324.029884:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145294976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175324.029936:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145294976:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175324.029941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175324.029949:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175324.029954:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175324.029963:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9058
00000100:00080000:2.0:1786175324.029980:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175324.029988:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175324.029996:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175324.030020:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145295104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175324.030127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145295104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175324.541039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175324.541180:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175325.053051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175325.565044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175325.565140:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175326.077055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175326.588994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175326.589077:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175327.100996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786175327.101152:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786175327.101197:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786175327.101215:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175327.101258:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786175327.101270:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175327.101280:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175327.101289:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786175327.101290:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87c380 x1872931145295104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786175327.101298:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175327.101309:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786175327.101323:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145295104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786175327.101329:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175327.101342:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786175327.101345:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101355:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101360:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145295104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175327.101369:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87c700 x1872931145294976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175327.101386:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145294976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175327.101396:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101400:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101404:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145294976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175327.101412:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87c000 x1872931145294848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175327.101427:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145294848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175327.101435:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101438:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101442:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145294848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175327.101449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87dc00 x1872931145294720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175327.101460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145294720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175327.101467:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101470:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101474:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145294720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175327.101480:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87f800 x1872931145294592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175327.101492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145294592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175327.101500:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101504:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145294592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175327.101514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87df80 x1872931145294464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175327.101527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145294464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175327.101534:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101541:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145294464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175327.101548:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87d500 x1872931145294208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175327.101561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145294208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175327.101571:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101575:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145294208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175327.101586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87f100 x1872931145294336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175327.101599:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145294336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175327.101609:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101613:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101617:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145294336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175327.101638:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175324/real 1786175327]  req@ffff89d99e87d880 x1872931145294080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175327.101655:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145294080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175327.101667:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175327.101670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175327.101674:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145294080:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175327.612977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175327.613170:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175328.124972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175328.636986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175328.637043:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175329.149062:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175329.149070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.149081:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175329.149087:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175329.149098:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9063
00000100:00080000:2.0:1786175329.149110:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175329.149119:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175329.149169:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145295232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175329.149201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.149205:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175329.149208:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175329.149213:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9063
00000100:00080000:2.0:1786175329.149217:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175329.149223:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175329.149239:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175329.149246:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145295232:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175329.149262:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145295360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175329.149285:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.149300:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175329.149303:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175329.149319:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9063
00000100:00080000:2.0:1786175329.149330:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175329.149335:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175329.149342:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175329.149343:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175329.149370:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145295488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175329.149382:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.149386:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175329.149388:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175329.149394:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9063
00000100:00080000:2.0:1786175329.149401:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175329.149406:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175329.149413:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175329.149416:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87ca80 x1872931145295232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175329.149433:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145295616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175329.149450:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.149453:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175329.149455:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175329.149465:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9063
00000100:00080000:2.0:1786175329.149471:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175329.149474:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145295232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175329.149481:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175329.149489:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175329.149510:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145295744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175329.149524:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175329.149534:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175329.149549:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145295232:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175329.149552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.149562:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175329.149565:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175329.149574:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9063
00000100:00080000:2.0:1786175329.149579:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175329.149586:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175329.149591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145295360:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175329.149598:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175329.149659:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175329.149668:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145295872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175329.149687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87e680 x1872931145295360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175329.149690:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.149706:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175329.149712:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175329.149723:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9063
00000100:00100000:1.0:1786175329.149731:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145295360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175329.149735:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175329.149749:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175329.149761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175329.149764:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175329.149774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175329.149782:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145295360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175329.149790:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145296000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175329.149801:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145295488:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175329.149829:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.149835:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175329.149838:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175329.149846:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9063
00000800:00000100:1.0:1786175329.149854:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175329.149858:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175329.149870:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175329.149878:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175329.149883:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87ed80 x1872931145295488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175329.149948:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145295488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175329.149955:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145296128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175329.149989:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175329.149991:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175329.150005:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175329.150006:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175329.150013:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175329.150020:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145295488:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175329.150027:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9063
00000100:00080000:2.0:1786175329.150037:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175329.150042:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145295616:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175329.150049:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175329.150061:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175329.150083:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145296256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175329.150095:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175329.150124:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87d880 x1872931145295616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175329.150144:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145295616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175329.150155:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175329.150160:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175329.150165:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145295616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175329.150173:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145295744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175329.150202:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175329.150219:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87f100 x1872931145295744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175329.150236:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145295744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175329.150247:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175329.150251:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175329.150256:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145295744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175329.150286:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145295872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175329.150314:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175329.150331:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87d500 x1872931145295872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175329.150349:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145295872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175329.150362:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175329.150366:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175329.150372:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145295872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175329.150382:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145296000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175329.150410:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175329.150427:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87df80 x1872931145296000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175329.150445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145296000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175329.150457:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175329.150462:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175329.150466:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145296000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175329.150475:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145296128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175329.150505:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175329.150522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87f800 x1872931145296128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175329.150540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145296128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175329.150554:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175329.150558:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175329.150563:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145296128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175329.150572:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145296256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175329.150600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175329.150644:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175329/real 1786175329]  req@ffff89d99e87dc00 x1872931145296256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175329.150664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145296256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175329.150677:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175329.150683:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175329.150688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145296256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175329.660999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175329.661098:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175330.173071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786175330.685090:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175330.685152:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175331.197010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786175331.708981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175331.709109:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175332.220972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175332.733002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175332.733053:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175333.245007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175333.757070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175333.757225:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175334.268977:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175334.268982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175334.268992:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175334.268996:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175334.269006:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:3.0:1786175334.269014:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175334.269020:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175334.269052:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145296384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175334.269078:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175334.269081:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175334.269082:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175334.269085:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:3.0:1786175334.269087:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175334.269090:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175334.269098:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175334.269106:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145296384:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175334.269110:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145296512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175334.269119:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175334.269121:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175334.269122:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175334.269126:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:3.0:1786175334.269128:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175334.269131:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175334.269134:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175334.269143:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145296640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175334.269149:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175334.269151:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175334.269152:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175334.269154:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:3.0:1786175334.269158:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175334.269161:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175334.269164:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175334.269172:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175334.269174:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145296768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175334.269182:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175334.269184:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175334.269186:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175334.269189:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:3.0:1786175334.269191:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175334.269194:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175334.269197:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175334.269204:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145296896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175334.269209:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175334.269212:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175334.269213:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175334.269216:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:3.0:1786175334.269218:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175334.269221:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe67480 x1872931145296384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175334.269223:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175334.269230:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175334.269242:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145297024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175334.269247:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145296384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175334.269277:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175334.269278:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175334.269283:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175334.269284:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175334.269288:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175334.269291:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145296384:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175334.269295:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:3.0:1786175334.269299:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175334.269302:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175334.269306:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175334.269312:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145297152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175334.269318:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145296512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175334.269322:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175334.269329:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175334.269338:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175334.269342:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:3.0:1786175334.269346:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786175334.269348:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175334.269352:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175334.269357:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175334.269362:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe67100 x1872931145296512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175334.269368:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145297280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175334.269379:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145296512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175334.269381:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175334.269389:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175334.269392:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175334.269393:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175334.269398:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9068
00000100:00080000:1.0:1786175334.269399:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175334.269405:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145296512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175334.269406:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175334.269413:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175334.269416:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145296640:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175334.269419:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175334.269431:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145297408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175334.269436:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175334.269449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe66a00 x1872931145296640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175334.269458:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145296640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175334.269464:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175334.269466:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175334.269468:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145296640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175334.269472:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145296768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175334.269483:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175334.269488:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe66300 x1872931145296768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175334.269500:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145296768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175334.269505:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175334.269506:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175334.269508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145296768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175334.269511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145296896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175334.269521:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175334.269526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe65880 x1872931145296896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175334.269532:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145296896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175334.269537:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175334.269539:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175334.269541:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145296896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175334.269544:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145297024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175334.269553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175334.269584:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe65500 x1872931145297024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175334.269591:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145297024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175334.269601:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175334.269603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175334.269605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145297024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175334.269618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145297152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175334.269632:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175334.269639:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe64700 x1872931145297152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175334.269646:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145297152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175334.269651:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175334.269652:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175334.269654:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145297152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175334.269658:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145297280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175334.269668:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175334.269673:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe64a80 x1872931145297280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175334.269681:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145297280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175334.269685:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175334.269687:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175334.269689:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145297280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175334.269693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145297408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175334.269702:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175334.269707:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175334/real 1786175334]  req@ffff89d99fe67480 x1872931145297408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175334.269713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145297408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175334.269726:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175334.269728:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175334.269730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145297408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175334.781003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175334.781073:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175335.292982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175335.805034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175335.805106:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175336.316986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175336.829011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175336.829088:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175337.340972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175337.852992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175337.853031:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175338.365047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175338.876985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175338.877056:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175339.388965:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175339.388973:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175339.388978:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.388987:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00100000:1.0:1786175339.388991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175339.389004:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175339.389014:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175339.389053:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145297536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175339.389077:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175339.389080:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175339.389082:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.389085:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00080000:3.0:1786175339.389088:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175339.389092:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175339.389101:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175339.389110:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145297536:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175339.389117:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145297664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175339.389131:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175339.389135:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175339.389137:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.389142:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00080000:3.0:1786175339.389147:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175339.389151:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175339.389157:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175339.389168:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175339.389169:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145297792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175339.389179:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175339.389182:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175339.389183:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.389187:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00080000:3.0:1786175339.389190:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175339.389193:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175339.389197:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175339.389209:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe64000 x1872931145297536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175339.389210:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145297920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175339.389236:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175339.389240:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175339.389242:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.389245:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00080000:3.0:1786175339.389248:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175339.389252:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175339.389256:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145297536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175339.389256:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175339.389268:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175339.389272:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145298048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175339.389275:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175339.389282:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145297536:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175339.389294:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175339.389299:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175339.389301:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.389305:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00080000:3.0:1786175339.389309:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175339.389311:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145297664:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175339.389316:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175339.389322:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175339.389333:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145298176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175339.389337:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175339.389347:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175339.389351:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe64380 x1872931145297664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175339.389352:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175339.389355:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.389362:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00080000:3.0:1786175339.389368:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175339.389372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145297664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175339.389373:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175339.389378:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175339.389387:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175339.389390:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145298304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175339.389393:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175339.389401:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145297664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175339.389412:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145297792:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175339.389416:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175339.389419:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175339.389421:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.389424:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00080000:3.0:1786175339.389427:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175339.389432:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175339.389433:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175339.389436:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175339.389445:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe66d80 x1872931145297792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175339.389448:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145298432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175339.389476:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175339.389479:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145297792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175339.389480:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175339.389484:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175339.389491:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9073
00000100:00080000:1.0:1786175339.389494:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175339.389495:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175339.389501:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175339.389502:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175339.389523:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175339.389527:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145297792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175339.389537:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145297920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175339.389538:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145298560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175339.389562:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175339.389572:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe66680 x1872931145297920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175339.389580:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145297920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175339.389585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175339.389587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175339.389589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145297920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175339.389593:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145298048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175339.389602:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175339.389607:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe67800 x1872931145298048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175339.389615:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145298048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175339.389619:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175339.389621:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175339.389623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145298048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175339.389638:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145298176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175339.389655:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175339.389667:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe65180 x1872931145298176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175339.389687:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145298176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175339.389702:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175339.389704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175339.389709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145298176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175339.389714:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145298304:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175339.389729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175339.389736:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe67b80 x1872931145298304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175339.389744:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145298304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175339.389749:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175339.389751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175339.389753:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145298304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175339.389757:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145298432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175339.389766:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175339.389771:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe65f80 x1872931145298432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175339.389778:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145298432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175339.389788:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175339.389790:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175339.389792:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145298432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175339.389795:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145298560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175339.389804:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175339.389809:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175339/real 1786175339]  req@ffff89d99fe64000 x1872931145298560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175339.389816:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145298560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175339.389822:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175339.389825:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175339.389828:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145298560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175339.900982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175339.901029:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175340.413004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175340.925077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175340.925179:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175341.436996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175341.949022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175341.949115:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175342.461023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175342.972984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175342.973037:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175343.485003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175343.997054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175343.997126:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175344.509067:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175344.509073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175344.509079:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175344.509086:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175344.509097:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00080000:2.0:1786175344.509109:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175344.509117:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175344.509159:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145298688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175344.509191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175344.509195:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175344.509197:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175344.509201:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00080000:2.0:1786175344.509205:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175344.509208:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175344.509218:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175344.509231:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145298816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175344.509243:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175344.509248:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145298688:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175344.509249:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175344.509253:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175344.509263:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00080000:2.0:1786175344.509267:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175344.509270:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175344.509275:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175344.509288:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145298944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175344.509304:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175344.509309:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175344.509310:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175344.509314:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00080000:2.0:1786175344.509317:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175344.509320:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175344.509325:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175344.509335:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145299072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175344.509345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175344.509348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175344.509350:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786175344.509358:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175344.509359:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00080000:2.0:1786175344.509367:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175344.509371:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175344.509375:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175344.509399:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145299200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175344.509409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175344.509412:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175344.509415:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175344.509422:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00100000:1.0:1786175344.509427:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87c000 x1872931145298688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175344.509427:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175344.509437:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175344.509447:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175344.509489:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145299328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175344.509498:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175344.509502:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175344.509504:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175344.509512:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00100000:1.0:1786175344.509516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145298688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175344.509517:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175344.509526:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175344.509535:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175344.509551:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145299456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175344.509553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.509570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175344.509572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175344.509579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175344.509582:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175344.509587:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00080000:2.0:1786175344.509590:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175344.509594:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145298688:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175344.509596:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175344.509605:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175344.509618:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145299584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175344.509651:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145298816:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175344.509661:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175344.509667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175344.509668:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175344.509673:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9078
00000100:00080000:2.0:1786175344.509677:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175344.509680:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175344.509685:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175344.509699:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145299712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175344.509721:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175344.509749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87c700 x1872931145298816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175344.509778:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145298816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175344.509791:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.509797:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175344.509801:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145298816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175344.509811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145298944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175344.509843:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175344.509862:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87c380 x1872931145298944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175344.509880:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145298944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175344.509893:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.509935:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175344.509941:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145298944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175344.509952:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145299072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175344.509985:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175344.510004:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87dc00 x1872931145299072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175344.510023:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145299072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175344.510035:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.510040:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175344.510045:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145299072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175344.510055:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145299200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175344.510084:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175344.510101:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87f800 x1872931145299200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175344.510120:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145299200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175344.510132:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.510137:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175344.510142:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145299200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175344.510152:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145299328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175344.510180:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175344.510198:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87df80 x1872931145299328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175344.510218:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145299328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175344.510232:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.510237:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175344.510242:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145299328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175344.510251:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145299456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175344.510281:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175344.510299:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87d500 x1872931145299456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175344.510317:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145299456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175344.510330:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.510335:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175344.510340:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145299456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175344.510372:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145299584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175344.510403:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175344.510422:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87f100 x1872931145299584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175344.510441:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145299584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175344.510493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.510498:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175344.510504:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145299584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175344.510514:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145299712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175344.510544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175344.510570:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175344/real 1786175344]  req@ffff89d99e87d880 x1872931145299712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175344.510587:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145299712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175344.510600:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175344.510604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175344.510609:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145299712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175345.020978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175345.021074:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175345.532986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175346.044999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175346.045038:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175346.556973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175347.069008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175347.069096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175347.581014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175348.092992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175348.093040:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175348.605079:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:2.0:1786175349.117042:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175349.117068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786175349.628977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175349.628990:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.628997:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175349.629002:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175349.629013:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:0.0:1786175349.629023:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175349.629031:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175349.629064:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145299840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175349.629087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.629089:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175349.629091:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175349.629093:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:0.0:1786175349.629096:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175349.629102:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175349.629112:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175349.629120:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145299840:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175349.629128:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145299968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175349.629142:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.629146:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175349.629148:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175349.629153:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:0.0:1786175349.629179:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175349.629184:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175349.629188:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175349.629193:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175349.629209:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145300096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175349.629217:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.629220:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175349.629221:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175349.629225:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:0.0:1786175349.629228:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175349.629231:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175349.629235:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f0700 x1872931145299840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175349.629238:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175349.629254:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145300224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175349.629258:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145299840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175349.629271:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.629275:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175349.629276:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175349.629277:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175349.629286:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:1.0:1786175349.629286:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175349.629293:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175349.629296:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145299840:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175349.629300:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175349.629306:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175349.629314:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145300352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175349.629321:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.629324:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175349.629325:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175349.629330:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145299968:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175349.629338:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:0.0:1786175349.629342:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175349.629346:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175349.629350:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175349.629353:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175349.629364:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145300480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175349.629370:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f1500 x1872931145299968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175349.629379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.629385:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175349.629387:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175349.629390:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145299968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175349.629394:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:0.0:1786175349.629400:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175349.629405:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175349.629406:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175349.629425:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175349.629428:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145299968:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175349.629437:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175349.629438:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145300096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175349.629450:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145300608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175349.629467:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175349.629496:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.629499:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175349.629501:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175349.629505:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f2680 x1872931145300096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175349.629509:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:0.0:1786175349.629516:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175349.629522:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175349.629526:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175349.629526:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145300096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175349.629542:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145300736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175349.629558:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175349.629560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175349.629567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175349.629570:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175349.629570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175349.629581:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145300096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175349.629583:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9083
00000100:00080000:0.0:1786175349.629589:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175349.629594:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175349.629597:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145300224:192.168.202.130@tcp:8:kworker.0
00000008:00100000:0.0:1786175349.629600:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175349.629612:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145300864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175349.629625:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175349.629640:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f3b80 x1872931145300224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175349.629665:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145300224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175349.629671:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175349.629673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175349.629675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145300224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175349.629687:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145300352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175349.629700:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175349.629706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f3480 x1872931145300352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175349.629730:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145300352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175349.629735:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175349.629737:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175349.629748:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145300352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175349.629753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145300480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175349.629766:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175349.629774:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f2d80 x1872931145300480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175349.629798:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145300480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175349.629803:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175349.629805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175349.629807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145300480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175349.629811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145300608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175349.629821:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175349.629826:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f2a00 x1872931145300608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175349.629833:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145300608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175349.629838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175349.629840:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175349.629842:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145300608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175349.629845:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145300736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175349.629854:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175349.629860:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f0e00 x1872931145300736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175349.629867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145300736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175349.629873:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175349.629874:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175349.629876:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145300736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175349.629880:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145300864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175349.629889:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175349.629894:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175349/real 1786175349]  req@ffff89d9870f1880 x1872931145300864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175349.629901:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145300864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175349.629907:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175349.629908:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175349.629926:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145300864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175350.141022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175350.141109:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175350.653011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175351.164980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175351.165064:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175351.676955:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175352.188984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175352.189042:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175352.700968:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175353.212976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175353.213041:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175353.724980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175354.237048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175354.237156:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175354.749054:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175354.749064:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175354.749069:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175354.749080:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9088
00000100:00080000:0.0:1786175354.749091:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175354.749092:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175354.749102:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175354.749153:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145300992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175354.749178:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175354.749181:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175354.749183:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175354.749187:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9088
00000100:00080000:0.0:1786175354.749190:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175354.749194:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175354.749204:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175354.749218:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145301120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175354.749220:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145300992:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175354.749242:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175354.749246:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175354.749248:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175354.749253:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9088
00000100:00080000:0.0:1786175354.749274:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175354.749279:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175354.749286:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175354.749304:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145301248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175354.749318:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175354.749323:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175354.749325:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175354.749332:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9088
00000800:00000100:1.0:1786175354.749342:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175354.749344:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175354.749354:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175354.749386:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175354.749405:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145301376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175354.749433:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175354.749436:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175354.749438:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175354.749445:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f3100 x1872931145300992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175354.749446:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9088
00000100:00080000:0.0:1786175354.749455:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175354.749464:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175354.749490:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175354.749504:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145300992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175354.749511:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145301504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175354.749561:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175354.749561:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175354.749575:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175354.749580:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175354.749582:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175354.749618:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9088
00000100:00100000:1.0:1786175354.749619:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145300992:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175354.749623:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175354.749631:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175354.749636:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175354.749647:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145301632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175354.749658:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175354.749664:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786175354.749665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145301120:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175354.749667:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175354.749676:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9088
00000100:00080000:0.0:1786175354.749682:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175354.749685:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175354.749690:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175354.749702:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145301760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175354.749710:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175354.749716:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786175354.749717:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175354.749719:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175354.749727:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9088
00000100:00080000:0.0:1786175354.749732:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175354.749736:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175354.749741:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175354.749746:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f0a80 x1872931145301120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175354.749755:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145301888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175354.749770:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145301120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175354.749782:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175354.749791:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175354.749795:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175354.749796:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175354.749801:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9088
00000100:00080000:0.0:1786175354.749807:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175354.749807:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175354.749817:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175354.749819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145301120:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175354.749825:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175354.749832:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145301248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175354.749839:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145302016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175354.749872:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175354.749902:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f1180 x1872931145301248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175354.749987:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145301248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175354.749995:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175354.749998:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175354.750002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145301248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175354.750008:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145301376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175354.750029:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175354.750039:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f1880 x1872931145301376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175354.750050:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145301376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175354.750057:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175354.750059:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175354.750062:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145301376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175354.750067:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145301504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175354.750081:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175354.750089:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f0e00 x1872931145301504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175354.750099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145301504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175354.750119:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175354.750124:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175354.750128:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145301504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175354.750155:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145301632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175354.750184:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175354.750197:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f2a00 x1872931145301632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175354.750208:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145301632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175354.750236:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175354.750239:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175354.750244:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145301632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175354.750252:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145301760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175354.750275:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175354.750288:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f2d80 x1872931145301760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175354.750302:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145301760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175354.750311:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175354.750314:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175354.750319:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145301760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175354.750325:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145301888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175354.750343:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175354.750353:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f3480 x1872931145301888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175354.750412:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145301888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175354.750425:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175354.750428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175354.750431:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145301888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175354.750436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145302016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175354.750455:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175354.750486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175354/real 1786175354]  req@ffff89d9870f3b80 x1872931145302016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175354.750501:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145302016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175354.750511:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175354.750514:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175354.750518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145302016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175355.261044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175355.261132:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175355.772961:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175356.285041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175356.285093:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175356.796996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175357.308992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175357.309036:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175357.820965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175358.333032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175358.333128:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175358.844997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175359.357014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175359.357078:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175359.868971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175359.869003:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175359.869009:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175359.869012:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175359.869019:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00080000:3.0:1786175359.869027:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175359.869033:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175359.869063:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145302144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175359.869083:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175359.869099:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175359.869101:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175359.869104:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00080000:3.0:1786175359.869108:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175359.869111:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175359.869119:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175359.869120:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145302144:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175359.869130:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145302272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175359.869143:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175359.869146:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175359.869148:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175359.869151:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00080000:3.0:1786175359.869153:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175359.869156:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175359.869159:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175359.869167:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145302400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175359.869174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786175359.869178:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175359.869180:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175359.869182:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175359.869186:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00080000:3.0:1786175359.869190:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175359.869193:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175359.869197:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175359.869205:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145302528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175359.869212:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175359.869215:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786175359.869218:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe67480 x1872931145302144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175359.869219:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175359.869226:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00080000:3.0:1786175359.869233:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175359.869237:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175359.869240:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175359.869244:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145302144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175359.869251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145302656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175359.869257:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175359.869260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175359.869272:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175359.869273:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175359.869275:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175359.869279:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00100000:1.0:1786175359.869283:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145302144:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175359.869284:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175359.869292:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175359.869295:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175359.869301:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145302784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175359.869320:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145302272:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175359.869327:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175359.869331:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175359.869333:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175359.869337:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00080000:3.0:1786175359.869341:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786175359.869346:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175359.869347:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175359.869367:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175359.869373:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe64a80 x1872931145302272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175359.869379:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145302912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175359.869389:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145302272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175359.869407:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175359.869409:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175359.869410:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175359.869415:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175359.869417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175359.869422:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00100000:1.0:1786175359.869425:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145302272:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175359.869427:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175359.869434:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175359.869436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145302400:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175359.869439:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175359.869452:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145303040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175359.869458:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175359.869465:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175359.869468:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786175359.869471:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe64700 x1872931145302400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175359.869472:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175359.869480:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9094
00000100:00080000:3.0:1786175359.869486:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175359.869490:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175359.869492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145302400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175359.869494:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175359.869505:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175359.869509:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145303168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175359.869512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175359.869519:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145302400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175359.869530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145302528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175359.869544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175359.869553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe65500 x1872931145302528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175359.869561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145302528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175359.869566:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175359.869568:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175359.869569:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145302528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175359.869573:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145302656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175359.869583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175359.869604:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe65880 x1872931145302656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175359.869612:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145302656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175359.869617:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175359.869619:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175359.869621:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145302656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175359.869634:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145302784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175359.869645:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175359.869660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe66300 x1872931145302784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175359.869668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145302784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175359.869673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175359.869675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175359.869677:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145302784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175359.869680:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145302912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175359.869690:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175359.869695:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe66a00 x1872931145302912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175359.869703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145302912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175359.869708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175359.869710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175359.869712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145302912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175359.869715:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145303040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175359.869725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175359.869730:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe67100 x1872931145303040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175359.869737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145303040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175359.869742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175359.869744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175359.869746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145303040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175359.869749:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145303168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175359.869761:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175359.869770:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175359/real 1786175359]  req@ffff89d99fe67480 x1872931145303168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175359.869793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145303168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175359.869801:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175359.869804:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175359.869808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145303168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175360.381086:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175360.381172:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175360.892976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175361.405037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175361.405098:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175361.917019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175362.429037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175362.429118:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175362.941053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:2.0:1786175363.453004:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175363.453033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786175363.965026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175364.477037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175364.477062:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175364.989040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175364.989050:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175364.989055:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175364.989066:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00080000:3.0:1786175364.989075:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175364.989085:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175364.989094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786175364.989121:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145303296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175364.989157:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175364.989161:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175364.989163:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175364.989168:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00080000:3.0:1786175364.989173:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175364.989177:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175364.989197:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175364.989206:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145303296:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175364.989215:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145303424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175364.989228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175364.989232:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175364.989234:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175364.989239:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00080000:3.0:1786175364.989243:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175364.989248:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175364.989279:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175364.989295:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145303552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175364.989310:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175364.989324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175364.989329:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175364.989331:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175364.989337:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00080000:3.0:1786175364.989342:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175364.989347:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175364.989352:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175364.989370:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145303680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175364.989373:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe64000 x1872931145303296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175364.989398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175364.989402:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175364.989404:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175364.989408:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00100000:2.0:1786175364.989413:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145303296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175364.989414:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175364.989422:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175364.989430:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175364.989437:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175364.989452:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145303808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175364.989453:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175364.989464:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145303296:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175364.989474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175364.989480:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175364.989483:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175364.989490:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00100000:2.0:1786175364.989496:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145303424:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175364.989498:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175364.989508:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175364.989516:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175364.989522:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175364.989537:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145303936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175364.989540:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe65f80 x1872931145303424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175364.989552:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145303424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175364.989559:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175364.989561:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175364.989564:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145303424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175364.989569:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145303552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175364.989583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175364.989591:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe67b80 x1872931145303552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175364.989600:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145303552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175364.989607:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175364.989609:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175364.989612:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145303552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175364.989618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145303680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175364.989635:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175364.989636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175364.989640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175364.989643:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175364.989649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe65180 x1872931145303680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175364.989660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145303680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175364.989666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175364.989668:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175364.989671:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145303680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175364.989677:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145303808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175364.989705:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175364.989718:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe67800 x1872931145303808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175364.989734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145303808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175364.989745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175364.989749:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175364.989754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145303808:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175364.989771:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00080000:3.0:1786175364.989777:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175364.989783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145303936:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175364.989785:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175364.989795:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175364.989817:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175364.989839:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe66680 x1872931145303936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175364.989857:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145304064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175364.989863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145303936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175364.989876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175364.989878:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175364.989884:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175364.989888:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175364.989889:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175364.989938:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00100000:2.0:1786175364.989943:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145303936:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175364.989944:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175364.989957:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175364.989967:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175364.989973:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145304064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175364.989987:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145304192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175364.989999:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175364.990013:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe66d80 x1872931145304064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175364.990029:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175364.990036:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145304064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175364.990036:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175364.990041:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175364.990051:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9099
00000100:00080000:2.0:1786175364.990055:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175364.990057:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175364.990062:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175364.990067:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175364.990072:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145304064:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175364.990076:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175364.990086:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145304192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175364.990094:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145304320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175364.990109:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175364.990121:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe64380 x1872931145304192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175364.990132:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145304192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175364.990144:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175364.990147:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175364.990150:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145304192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175364.990158:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145304320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175364.990170:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175364.990177:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175364/real 1786175364]  req@ffff89d99fe66d80 x1872931145304320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175364.990196:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145304320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175389 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175364.990202:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175364.990204:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175364.990207:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145304320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175365.501091:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175365.501158:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175366.012998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175366.525009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175366.525123:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175367.036969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175367.548991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175367.549062:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175368.060997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175368.572974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175368.573090:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175369.085018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786175369.597129:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175369.597129:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175370.108997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175370.109012:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175370.109022:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175370.109027:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175370.109037:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9104
00000100:00080000:3.0:1786175370.109047:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175370.109055:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175370.109093:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145304448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175370.109122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175370.109126:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175370.109128:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175370.109131:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9104
00000100:00080000:3.0:1786175370.109135:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175370.109139:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175370.109148:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175370.109161:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145304576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175370.109167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145304448:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175370.109179:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175370.109183:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175370.109184:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175370.109189:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9104
00000100:00080000:3.0:1786175370.109192:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175370.109195:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175370.109199:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175370.109238:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145304704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175370.109248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175370.109252:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175370.109253:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175370.109257:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9104
00000800:00000100:2.0:1786175370.109263:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175370.109265:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175370.109272:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175370.109279:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175370.109292:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145304832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175370.109308:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175370.109310:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe66680 x1872931145304448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175370.109316:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175370.109321:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175370.109333:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9104
00000100:00080000:3.0:1786175370.109339:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175370.109343:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175370.109347:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145304448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175370.109349:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175370.109367:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175370.109369:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145304960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175370.109377:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175370.109386:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145304448:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175370.109389:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175370.109395:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175370.109398:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175370.109403:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9104
00000100:00080000:3.0:1786175370.109406:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175370.109409:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175370.109414:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175370.109419:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145304576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175370.109428:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145305088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175370.109441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175370.109445:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175370.109447:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175370.109452:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175370.109457:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9104
00000100:00080000:3.0:1786175370.109463:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175370.109467:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175370.109473:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175370.109474:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe67800 x1872931145304576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175370.109487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145305216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175370.109492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145304576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175370.109517:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175370.109520:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175370.109522:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175370.109528:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175370.109529:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175370.109538:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145304576:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175370.109540:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9104
00000100:00080000:3.0:1786175370.109550:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175370.109556:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145304704:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175370.109557:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175370.109567:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175370.109582:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145305344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175370.109591:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175370.109600:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175370.109604:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786175370.109610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe65180 x1872931145304704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175370.109611:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175370.109623:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9104
00000100:00080000:3.0:1786175370.109633:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175370.109638:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145304704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175370.109639:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175370.109648:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175370.109662:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145305472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175370.109664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175370.109678:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175370.109690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145304704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175370.109706:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145304832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175370.109734:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175370.109746:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe67b80 x1872931145304832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175370.109757:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145304832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175370.109765:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175370.109768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175370.109771:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145304832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175370.109776:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145304960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175370.109790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175370.109797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe65f80 x1872931145304960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175370.109807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145304960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175370.109813:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175370.109816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175370.109818:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145304960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175370.109833:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145305088:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175370.109847:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175370.109855:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe64000 x1872931145305088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175370.109866:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145305088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175370.109873:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175370.109876:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175370.109878:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145305088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175370.109883:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145305216:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175370.109920:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175370.109931:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe67480 x1872931145305216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175370.109942:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145305216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175370.109949:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175370.109952:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175370.109955:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145305216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175370.109962:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145305344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175370.109988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175370.110004:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe67100 x1872931145305344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175370.110022:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145305344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175370.110043:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175370.110046:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175370.110049:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145305344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175370.110055:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145305472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175370.110076:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175370.110086:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175370/real 1786175370]  req@ffff89d99fe66a00 x1872931145305472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175370.110096:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145305472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175370.110103:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175370.110106:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175370.110109:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145305472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175370.621024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175370.621026:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175371.133038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175371.645031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175371.645078:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175372.156982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175372.669012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175372.669077:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175373.181027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175373.692987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175373.693017:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175374.204982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175374.717081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175374.717226:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175375.228993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175375.229079:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175375.229089:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175375.229094:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175375.229107:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:0.0:1786175375.229119:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175375.229129:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175375.229192:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145305600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175375.229229:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175375.229235:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175375.229238:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175375.229244:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:0.0:1786175375.229250:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175375.229258:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175375.229271:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175375.229281:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145305600:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175375.229297:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145305728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175375.229317:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175375.229323:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175375.229326:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175375.229332:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:0.0:1786175375.229350:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175375.229374:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175375.229380:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175375.229390:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175375.229411:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145305856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175375.229425:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175375.229431:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f2680 x1872931145305600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229433:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175375.229439:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175375.229451:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:0.0:1786175375.229459:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175375.229460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145305600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229472:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175375.229477:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175375.229483:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175375.229484:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175375.229492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145305600:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175375.229517:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145305728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175375.229523:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145305984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175375.229543:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175375.229546:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175375.229554:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175375.229558:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175375.229563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f1500 x1872931145305728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229567:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:0.0:1786175375.229578:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175375.229585:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145305728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229590:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175375.229604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175375.229605:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175375.229612:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175375.229616:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145305728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175375.229622:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145305856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175375.229630:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145306112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175375.229643:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175375.229654:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175375.229657:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f0700 x1872931145305856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229665:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175375.229673:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175375.229677:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145305856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229685:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:2.0:1786175375.229691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175375.229695:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175375.229698:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175375.229707:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175375.229707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145305856:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175375.229722:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175375.229728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145305984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175375.229747:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145306240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175375.229753:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175375.229767:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f3b80 x1872931145305984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229771:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175375.229776:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175375.229779:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175375.229787:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:0.0:1786175375.229797:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175375.229804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145305984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229809:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175375.229821:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175375.229825:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175375.229833:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175375.229842:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145306368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175375.229843:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145305984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175375.229862:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145306112:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175375.229867:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175375.229874:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175375.229877:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175375.229886:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:0.0:1786175375.229893:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175375.229937:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175375.229946:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175375.229950:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175375.229967:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145306496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175375.229983:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175375.229986:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f3480 x1872931145306112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.229989:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175375.229994:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175375.230006:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9109
00000100:00080000:0.0:1786175375.230016:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175375.230023:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145306112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175375.230026:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175375.230038:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175375.230043:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175375.230050:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175375.230054:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145306112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175375.230060:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145306624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175375.230091:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145306240:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175375.230119:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175375.230130:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f2d80 x1872931145306240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175375.230140:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145306240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175375.230148:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175375.230151:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175375.230154:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145306240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175375.230158:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145306368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175375.230211:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175375.230221:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f2a00 x1872931145306368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175375.230230:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145306368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175375.230237:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175375.230257:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175375.230260:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145306368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175375.230265:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145306496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175375.230280:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175375.230288:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f0e00 x1872931145306496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175375.230297:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145306496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175375.230304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175375.230306:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175375.230309:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145306496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175375.230322:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145306624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175375.230339:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175375.230370:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175375/real 1786175375]  req@ffff89d9870f1880 x1872931145306624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175375.230385:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145306624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175375.230397:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175375.230401:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175375.230406:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145306624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175375.740999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175375.741085:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175376.253003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175376.765020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175376.765121:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175377.277017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175377.789014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175377.789041:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175378.300976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175378.813016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175378.813091:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175379.325029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175379.837029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175379.837238:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175380.349049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175380.349067:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175380.349075:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175380.349080:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175380.349090:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00080000:0.0:1786175380.349102:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175380.349125:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175380.349172:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145306752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175380.349205:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175380.349208:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175380.349210:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175380.349214:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00080000:0.0:1786175380.349217:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175380.349221:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175380.349230:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175380.349242:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145306880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175380.349253:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175380.349258:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:2.0:1786175380.349259:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145306752:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175380.349260:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175380.349271:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00080000:0.0:1786175380.349275:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175380.349279:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175380.349282:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175380.349295:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145307008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175380.349304:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175380.349307:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175380.349309:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175380.349313:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00080000:0.0:1786175380.349317:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175380.349320:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175380.349325:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175380.349336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175380.349338:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145307136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175380.349348:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175380.349351:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175380.349370:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175380.349375:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00080000:0.0:1786175380.349379:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175380.349383:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175380.349389:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175380.349406:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145307264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175380.349412:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f1180 x1872931145306752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175380.349476:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175380.349481:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1786175380.349485:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145306752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175380.349486:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175380.349499:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00080000:0.0:1786175380.349507:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175380.349517:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175380.349519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175380.349523:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175380.349530:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.349538:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145306752:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175380.349542:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145307392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175380.349556:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175380.349561:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175380.349564:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175380.349568:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00080000:0.0:1786175380.349587:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175380.349590:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175380.349594:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175380.349607:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145306880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175380.349608:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145307520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175380.349636:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175380.349641:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175380.349644:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175380.349652:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175380.349654:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00080000:0.0:1786175380.349665:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175380.349671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f0a80 x1872931145306880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175380.349685:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145306880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175380.349689:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175380.349697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175380.349703:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175380.349704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.349712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145306880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175380.349719:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145307008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175380.349726:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145307648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175380.349737:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175380.349741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175380.349745:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175380.349749:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175380.349755:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9114
00000100:00100000:2.0:1786175380.349759:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f3100 x1872931145307008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175380.349762:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175380.349775:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175380.349780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145307008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175380.349785:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175380.349792:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175380.349798:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.349801:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145307008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175380.349811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145307136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175380.349812:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145307776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175380.349829:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175380.349843:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f1880 x1872931145307136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175380.349862:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145307136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175380.349873:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175380.349877:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.349881:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145307136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175380.349889:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145307264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175380.349964:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175380.349976:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f0e00 x1872931145307264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175380.349986:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145307264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175380.349994:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175380.349996:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.349999:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145307264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175380.350004:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145307392:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175380.350019:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175380.350026:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f2a00 x1872931145307392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175380.350035:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145307392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175380.350047:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175380.350050:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.350052:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145307392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175380.350069:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145307520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175380.350083:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175380.350091:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f2d80 x1872931145307520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175380.350100:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145307520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175380.350106:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175380.350109:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.350133:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145307520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175380.350140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145307648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175380.350159:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175380.350169:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f3480 x1872931145307648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175380.350179:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145307648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175380.350186:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175380.350189:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.350192:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145307648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175380.350197:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145307776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175380.350209:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175380.350217:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175380/real 1786175380]  req@ffff89d9870f3b80 x1872931145307776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175380.350226:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145307776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175380.350253:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175380.350256:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175380.350259:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145307776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175380.861033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175380.861175:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175381.372999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175381.884994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175381.885063:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175382.397059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175382.909069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175382.909141:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175383.421017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175383.933042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175383.933195:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175384.445018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175384.957048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175384.957055:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175385.469057:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175385.469096:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1786175385.469098:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175385.469103:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175385.469121:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00080000:0.0:1786175385.469134:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175385.469145:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175385.469195:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145307904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175385.469235:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175385.469240:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175385.469243:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175385.469248:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00080000:0.0:1786175385.469252:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175385.469256:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175385.469268:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175385.469285:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145308032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175385.469300:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175385.469304:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175385.469307:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175385.469312:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00080000:0.0:1786175385.469316:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175385.469322:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145307904:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175385.469325:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175385.469339:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175385.469369:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145308160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175385.469384:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175385.469390:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175385.469394:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175385.469402:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00080000:0.0:1786175385.469412:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175385.469421:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175385.469430:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175385.469444:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175385.469475:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145308288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175385.469498:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175385.469504:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f0700 x1872931145307904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175385.469505:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175385.469512:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175385.469529:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00080000:0.0:1786175385.469545:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175385.469553:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145307904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175385.469559:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175385.469581:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175385.469585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175385.469599:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175385.469605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145307904:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175385.469623:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145308416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175385.469623:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145308032:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175385.469663:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175385.469668:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175385.469671:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175385.469678:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00080000:0.0:1786175385.469687:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175385.469695:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786175385.469703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175385.469710:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175385.469730:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f1500 x1872931145308032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175385.469738:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145308544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175385.469783:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145308032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175385.469794:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175385.469810:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175385.469817:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175385.469822:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175385.469828:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00080000:2.0:1786175385.469836:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175385.469837:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175385.469851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145308032:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175385.469852:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175385.469867:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175385.469884:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145308672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175385.469948:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145308160:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175385.469949:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175385.469965:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175385.469968:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175385.469976:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00080000:0.0:1786175385.469982:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175385.469987:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175385.469996:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175385.470013:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175385.470021:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145308800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175385.470037:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175385.470040:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f2680 x1872931145308160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175385.470046:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175385.470054:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175385.470095:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9119
00000100:00100000:2.0:1786175385.470103:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145308160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175385.470107:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175385.470124:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175385.470127:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175385.470133:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175385.470139:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175385.470147:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145308160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175385.470160:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145308928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175385.470163:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145308288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175385.470210:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175385.470230:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f3b80 x1872931145308288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175385.470261:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145308288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175385.470271:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175385.470275:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175385.470278:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145308288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175385.470286:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145308416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175385.470307:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175385.470325:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f3480 x1872931145308416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175385.470342:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145308416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175385.470354:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175385.470358:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175385.470364:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145308416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175385.470372:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145308544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175385.470391:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175385.470402:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f2d80 x1872931145308544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175385.470415:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145308544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175385.470432:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175385.470436:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175385.470440:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145308544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175385.470459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145308672:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175385.470479:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175385.470491:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f2a00 x1872931145308672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175385.470505:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145308672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175385.470515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175385.470518:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175385.470522:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145308672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175385.470528:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145308800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175385.470547:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175385.470557:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f0e00 x1872931145308800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175385.470571:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145308800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175385.470581:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175385.470584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175385.470589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145308800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175385.470595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145308928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175385.470612:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175385.470623:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175385/real 1786175385]  req@ffff89d9870f1880 x1872931145308928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175385.470636:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145308928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175385.470645:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175385.470648:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175385.470652:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145308928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175385.981018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175385.981160:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175386.493128:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175387.005042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175387.005166:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175387.516975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175388.029068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175388.029171:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175388.540990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175389.052990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175389.053095:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175389.564995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175390.076987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175390.077212:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175390.589105:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175390.589110:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.589126:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175390.589134:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.589150:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00080000:0.0:1786175390.589168:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175390.589182:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175390.589246:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145309056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175390.589293:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.589316:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175390.589321:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.589328:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00080000:0.0:1786175390.589335:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175390.589341:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175390.589355:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175390.589377:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145309184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175390.589403:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.589411:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:2.0:1786175390.589416:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145309056:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175390.589417:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.589450:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00080000:0.0:1786175390.589456:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175390.589461:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175390.589469:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175390.589488:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145309312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175390.589503:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.589508:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175390.589510:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.589515:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00080000:0.0:1786175390.589523:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175390.589528:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175390.589534:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175390.589546:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145309440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175390.589559:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.589564:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175390.589566:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.589571:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00080000:0.0:1786175390.589578:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175390.589582:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175390.589588:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175390.589600:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145309568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175390.589610:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.589614:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175390.589617:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.589622:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00080000:0.0:1786175390.589627:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175390.589635:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175390.589644:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175390.589656:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145309696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175390.589671:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145309184:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175390.589674:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.589694:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175390.589697:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.589708:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00080000:0.0:1786175390.589716:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175390.589724:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175390.589733:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175390.589757:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145309312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175390.589768:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145309824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175390.589802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145309440:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175390.589807:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.589820:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175390.589826:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.589839:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00100000:2.0:1786175390.589850:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145309568:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175390.589853:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175390.589883:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175390.589947:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175390.589985:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145309952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175390.589987:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145309696:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175390.590057:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175390.590063:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175390.590066:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175390.590074:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9124
00000100:00080000:0.0:1786175390.590081:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175390.590088:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145309824:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175390.590094:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175390.590108:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175390.590135:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145310080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175390.590184:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145309952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175390.590234:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145310080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175391.101103:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175391.101267:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175391.613219:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175392.125062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175392.125258:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175392.637065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175393.149044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175393.149118:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175393.661069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:1.0:1786175393.661335:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:1.0:1786175393.661412:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1786175393.661437:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175393.661510:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:1.0:1786175393.661535:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175393.661553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f3b80 x1872931145310080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786175393.661555:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175393.661579:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175393.661603:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145310080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.661621:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:1.0:1786175393.661624:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:2.0:1786175393.661633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.661643:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145310080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175393.661658:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f0a80 x1872931145309184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786175393.661674:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175393.661695:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145309184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.661706:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:1.0:1786175393.661713:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:2.0:1786175393.661717:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.661733:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145309184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175393.661743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f1180 x1872931145309312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786175393.661764:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175393.661782:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145309312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.661797:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175393.661804:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.661810:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145309312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175393.661822:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f1880 x1872931145309440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175393.661840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145309440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.661858:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175393.661863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.661866:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145309440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175393.661875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f0e00 x1872931145309568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175393.661888:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145309568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.661924:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175393.661928:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.661932:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145309568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175393.661941:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f3100 x1872931145309056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175393.661954:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145309056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.661962:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175393.661966:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.661969:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145309056:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175393.662037:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f3480 x1872931145309952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175393.662055:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145309952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.662069:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175393.662073:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.662076:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145309952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175393.662086:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f2a00 x1872931145309696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175393.662100:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145309696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.662108:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175393.662112:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.662116:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145309696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175393.662125:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175390/real 1786175393]  req@ffff89d9870f2d80 x1872931145309824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175393.662144:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145309824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175393.662152:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175393.662158:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175393.662161:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145309824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175394.173100:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175394.173151:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175394.685017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175395.197099:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175395.197223:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175395.709078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175395.709092:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175395.709109:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.709124:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.709142:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175395.709146:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175395.709154:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175395.709210:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145310208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175395.709247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175395.709253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175395.709255:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.709260:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.709276:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175395.709281:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175395.709295:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175395.709312:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145310336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175395.709329:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145310208:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175395.709329:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175395.709359:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175395.709362:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.709374:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.709378:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175395.709382:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175395.709390:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175395.709419:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145310464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175395.709438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175395.709445:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175395.709450:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.709460:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.709482:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175395.709492:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175395.709504:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175395.709507:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175395.709537:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145310592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175395.709562:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175395.709570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175395.709576:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.709585:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.709595:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175395.709605:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe66300 x1872931145310208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175395.709615:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175395.709634:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175395.709664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145310208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175395.709675:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145310720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175395.709721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175395.709729:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175395.709742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175395.709746:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1786175395.709758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145310208:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175395.709766:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.709782:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.709792:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175395.709802:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175395.709813:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175395.709817:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145310336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175395.709851:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145310848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175395.709882:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175395.709892:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175395.710002:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe65880 x1872931145310336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175395.710004:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175395.710012:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.710042:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.710052:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175395.710066:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175395.710078:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145310336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175395.710088:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175395.710117:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175395.710134:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145310976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175395.710141:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175395.710161:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145310336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175395.710191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175395.710199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145310464:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175395.710205:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175395.710215:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.710226:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.710235:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175395.710245:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175395.710256:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175395.710272:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175395.710293:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145311104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175395.710313:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe65500 x1872931145310464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175395.710340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175395.710357:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145310464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175395.710373:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175395.710380:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175395.710386:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145310464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175395.710398:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145310592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175395.710436:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175395.710457:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe64700 x1872931145310592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175395.710476:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145310592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175395.710489:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175395.710494:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175395.710500:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145310592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175395.710511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145310720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175395.710545:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175395.710565:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe64a80 x1872931145310720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175395.710595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145310720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175395.710609:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175395.710614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175395.710620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145310720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175395.710656:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145310848:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175395.710694:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175395.710714:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe66300 x1872931145310848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175395.710734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145310848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175395.710747:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175395.710753:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175395.710758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145310848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175395.710769:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145310976:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175395.710805:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175395.710824:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe66a00 x1872931145310976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175395.710842:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145310976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175395.710862:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175395.710868:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175395.710873:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145310976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175395.710884:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145311104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175395.711006:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175395.711029:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe67100 x1872931145311104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175395.711052:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145311104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175395.711070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175395.711080:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175395.711088:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145311104:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175395.711146:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175395.711153:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175395.711169:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9129
00000100:00080000:3.0:1786175395.711181:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175395.711192:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175395.711207:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175395.711245:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145311232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175395.711405:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145311232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175395.711461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175395.711490:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175395/real 1786175395]  req@ffff89d99fe67480 x1872931145311232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175395.711517:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145311232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175395.711536:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175395.711542:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175395.711565:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145311232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175396.221085:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175396.221247:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175396.733031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175397.244991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175397.245091:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175397.757029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175398.268986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175398.269094:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175398.781035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175399.293088:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175399.293127:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175399.805045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175400.317004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175400.317079:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175400.828997:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175400.829003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175400.829012:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175400.829017:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175400.829031:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829047:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175400.829058:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175400.829114:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145311360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175400.829151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175400.829156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175400.829158:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175400.829163:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829168:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175400.829173:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175400.829187:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175400.829196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145311360:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175400.829205:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145311488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175400.829220:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175400.829224:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175400.829227:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175400.829231:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829235:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175400.829240:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175400.829246:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175400.829260:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145311616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175400.829270:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175400.829274:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175400.829275:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175400.829280:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829284:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175400.829287:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175400.829293:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175400.829299:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175400.829306:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145311744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175400.829318:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175400.829322:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175400.829324:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175400.829329:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829334:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175400.829338:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175400.829345:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175400.829359:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe64000 x1872931145311360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175400.829368:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145311872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175400.829378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175400.829382:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145311360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175400.829383:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175400.829394:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.829398:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175400.829401:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145311360:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175400.829427:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145311488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175400.829450:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175400.829464:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe65f80 x1872931145311488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175400.829470:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175400.829479:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829484:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175400.829488:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145311488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175400.829490:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175400.829499:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175400.829504:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.829511:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175400.829513:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145312000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175400.829519:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145311488:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175400.829529:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175400.829534:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145311616:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175400.829535:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175400.829539:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175400.829546:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829549:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175400.829551:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175400.829555:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175400.829568:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145312128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175400.829569:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175400.829583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175400.829587:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe67b80 x1872931145311616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175400.829589:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175400.829593:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175400.829611:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145311616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175400.829620:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.829623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175400.829627:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145311616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175400.829634:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145311744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175400.829656:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175400.829664:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe65180 x1872931145311744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175400.829673:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145311744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175400.829679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.829681:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175400.829683:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145311744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175400.829687:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145311872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175400.829699:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175400.829706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe67800 x1872931145311872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175400.829715:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145311872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175400.829728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.829732:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175400.829737:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145311872:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175400.829743:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829749:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175400.829754:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175400.829760:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175400.829768:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145312000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175400.829773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145312256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175400.829787:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175400.829790:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175400.829792:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175400.829796:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9135
00000100:00080000:3.0:1786175400.829799:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175400.829804:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175400.829805:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175400.829811:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175400.829827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe66680 x1872931145312000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175400.829842:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145312000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175400.829854:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.829859:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175400.829862:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145312000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175400.829870:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145312128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175400.829883:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145312384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175400.829893:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175400.829948:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe66d80 x1872931145312128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175400.829960:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145312128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175400.829967:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.829970:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175400.829974:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145312128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175400.829990:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145312256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175400.830005:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175400.830012:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe64380 x1872931145312256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175400.830020:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145312256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175400.830026:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.830028:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175400.830031:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145312256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175400.830035:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145312384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175400.830044:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175400.830050:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175400/real 1786175400]  req@ffff89d99fe67800 x1872931145312384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175400.830058:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145312384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175400.830063:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175400.830065:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175400.830067:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145312384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175401.341005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175401.341075:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175401.853041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175402.365054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175402.365114:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175402.877029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175403.389026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175403.389092:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175403.901032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175404.413010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175404.413101:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175404.925046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175405.437026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175405.437094:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175405.949014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175405.949022:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175405.949027:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175405.949041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175405.949042:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949054:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175405.949062:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175405.949096:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145312512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175405.949118:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175405.949121:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175405.949122:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175405.949125:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949127:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175405.949130:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175405.949138:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175405.949148:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145312640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175405.949157:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175405.949161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145312512:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175405.949161:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175405.949164:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175405.949173:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949175:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175405.949177:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175405.949180:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175405.949190:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145312768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175405.949197:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175405.949200:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175405.949201:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175405.949203:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949206:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175405.949208:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175405.949211:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175405.949219:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145312896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175405.949225:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175405.949235:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175405.949238:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175405.949240:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175405.949244:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949247:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175405.949249:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175405.949252:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175405.949264:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe65180 x1872931145312512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175405.949275:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145313024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175405.949282:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145312512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175405.949284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175405.949291:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175405.949294:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175405.949301:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949305:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175405.949307:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175405.949308:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175405.949315:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175405.949317:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175405.949325:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145313152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175405.949327:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145312512:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175405.949344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175405.949348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175405.949350:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175405.949356:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949360:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175405.949366:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175405.949371:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145312640:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175405.949373:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175405.949389:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145313280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175405.949398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175405.949404:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175405.949404:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175405.949408:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175405.949413:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949417:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175405.949421:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175405.949425:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175405.949429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe67b80 x1872931145312640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175405.949436:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145313408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175405.949457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175405.949459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175405.949463:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145312640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175405.949463:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175405.949471:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9140
00000100:00080000:3.0:1786175405.949476:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175405.949480:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175405.949486:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175405.949487:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175405.949493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145313536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175405.949495:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175405.949506:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145312640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175405.949524:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145312768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175405.949543:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175405.949552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe65f80 x1872931145312768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175405.949561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145312768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175405.949567:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175405.949569:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175405.949571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145312768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175405.949575:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145312896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175405.949587:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175405.949592:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe64000 x1872931145312896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175405.949600:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145312896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175405.949605:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175405.949606:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175405.949608:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145312896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175405.949612:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145313024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175405.949621:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175405.949627:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe67480 x1872931145313024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175405.949634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145313024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175405.949651:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175405.949654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175405.949656:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145313024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175405.949660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145313152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175405.949671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175405.949678:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe67100 x1872931145313152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175405.949685:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145313152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175405.949690:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175405.949692:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175405.949694:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145313152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175405.949708:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145313280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175405.949719:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175405.949725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe66a00 x1872931145313280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175405.949732:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145313280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175405.949738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175405.949739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175405.949742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145313280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175405.949746:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145313408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175405.949755:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175405.949761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe66300 x1872931145313408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175405.949768:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145313408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175405.949773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175405.949774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175405.949776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145313408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175405.949780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145313536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175405.949796:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175405.949806:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175405/real 1786175405]  req@ffff89d99fe64a80 x1872931145313536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175405.949819:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145313536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175405.949829:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175405.949832:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175405.949836:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145313536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175406.461060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175406.461091:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175406.973039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175407.485002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175407.485079:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175407.996987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175408.508992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175408.509043:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175409.020963:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175409.533013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175409.533090:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175410.045032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175410.557045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175410.557106:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175411.069059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175411.069495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175411.069504:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175411.069509:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175411.069525:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:2.0:1786175411.069538:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175411.069548:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175411.069617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145313664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175411.069658:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175411.069663:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175411.069666:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175411.069671:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:2.0:1786175411.069675:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175411.069680:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175411.069702:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175411.069723:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145313792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175411.069737:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175411.069742:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145313664:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175411.069742:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175411.069746:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175411.069756:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:2.0:1786175411.069760:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175411.069765:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175411.069770:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175411.069784:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145313920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175411.069792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175411.069795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175411.069797:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175411.069801:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:2.0:1786175411.069805:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175411.069810:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175411.069827:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175411.069845:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145314048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175411.069855:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175411.069863:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175411.069868:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175411.069871:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175411.069877:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:2.0:1786175411.069883:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175411.069888:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175411.069934:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175411.069936:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87ed80 x1872931145313664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175411.069955:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145314176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175411.069964:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145313664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175411.069972:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175411.069984:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175411.069988:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175411.069989:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175411.069995:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:0.0:1786175411.069999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175411.070003:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175411.070006:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145313664:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175411.070013:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175411.070020:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175411.070036:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145314304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175411.070040:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145313792:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175411.070059:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175411.070064:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175411.070067:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175411.070076:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175411.070076:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:2.0:1786175411.070085:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175411.070090:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175411.070096:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87e680 x1872931145313792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175411.070098:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175411.070118:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145314432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175411.070119:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145313792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175411.070148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175411.070149:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175411.070156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175411.070157:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175411.070160:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175411.070165:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145313792:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175411.070169:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:2.0:1786175411.070176:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175411.070180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145313920:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175411.070182:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175411.070191:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175411.070208:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145314560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175411.070213:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175411.070225:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175411.070228:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87ca80 x1872931145313920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175411.070232:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175411.070237:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175411.070247:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9145
00000100:00080000:2.0:1786175411.070255:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175411.070261:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175411.070266:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145313920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175411.070268:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175411.070281:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145314688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175411.070308:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175411.070314:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175411.070319:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145313920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175411.070327:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145314048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175411.070349:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175411.070360:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87d880 x1872931145314048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175411.070372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145314048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175411.070381:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175411.070384:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175411.070387:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145314048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175411.070394:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145314176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175411.070410:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175411.070419:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87f100 x1872931145314176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175411.070431:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145314176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175411.070446:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175411.070449:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175411.070452:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145314176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175411.070468:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145314304:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175411.070495:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175411.070506:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87d500 x1872931145314304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175411.070518:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145314304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175411.070527:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175411.070532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175411.070535:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145314304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175411.070541:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145314432:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175411.070560:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175411.070572:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87df80 x1872931145314432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175411.070585:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145314432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175411.070593:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175411.070597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175411.070601:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145314432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175411.070607:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145314560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175411.070623:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175411.070633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87f800 x1872931145314560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175411.070645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145314560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175411.070654:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175411.070657:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175411.070661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145314560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175411.070667:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145314688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175411.070682:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175411.070691:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175411/real 1786175411]  req@ffff89d99e87dc00 x1872931145314688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175411.070703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145314688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175411.070712:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175411.070715:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175411.070719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145314688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175411.581037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175411.581123:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175412.093022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175412.605045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175412.605114:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175413.117008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175413.629047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175413.629095:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175414.141023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175414.652981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175414.653132:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175415.165019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175415.676971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175415.677084:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175416.189013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175416.189022:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175416.189026:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175416.189028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175416.189036:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00080000:3.0:1786175416.189048:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189056:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175416.189090:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145314816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175416.189113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175416.189116:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175416.189117:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175416.189120:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00080000:3.0:1786175416.189122:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189124:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175416.189131:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175416.189141:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145314944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175416.189149:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175416.189151:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175416.189153:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175416.189158:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00100000:0.0:1786175416.189161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145314816:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175416.189161:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189166:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175416.189174:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175416.189182:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145315072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175416.189188:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175416.189190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175416.189192:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175416.189194:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00080000:3.0:1786175416.189196:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189199:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175416.189201:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175416.189209:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145315200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175416.189215:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175416.189218:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175416.189219:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175416.189222:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00080000:3.0:1786175416.189225:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189228:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175416.189233:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175416.189235:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175416.189249:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145315328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175416.189261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175416.189264:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175416.189266:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175416.189272:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00080000:3.0:1786175416.189277:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189283:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175416.189284:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe64700 x1872931145314816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175416.189288:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175416.189301:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145315456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175416.189309:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175416.189313:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145314816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175416.189313:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175416.189317:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175416.189323:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00080000:3.0:1786175416.189328:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189334:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175416.189338:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175416.189339:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175416.189346:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145315584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175416.189348:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.189358:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145314816:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175416.189360:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175416.189367:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175416.189369:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175416.189373:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00080000:3.0:1786175416.189375:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189377:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175416.189380:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175416.189386:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145315712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175416.189390:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145314944:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175416.189400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175416.189403:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175416.189405:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175416.189408:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9150
00000100:00080000:3.0:1786175416.189410:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175416.189414:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175416.189418:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175416.189425:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175416.189433:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145315840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175416.189443:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe65500 x1872931145314944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175416.189458:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145314944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175416.189469:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175416.189473:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.189477:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145314944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175416.189484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145315072:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175416.189501:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175416.189511:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe65880 x1872931145315072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175416.189531:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145315072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175416.189540:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175416.189543:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.189547:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145315072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175416.189554:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145315200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175416.189573:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175416.189594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe64a80 x1872931145315200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175416.189607:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145315200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175416.189616:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175416.189619:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.189623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145315200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175416.189629:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145315328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175416.189646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175416.189656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe66300 x1872931145315328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175416.189668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145315328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175416.189708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175416.189711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.189715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145315328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175416.189721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145315456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175416.189740:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175416.189750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe66a00 x1872931145315456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175416.189762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145315456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175416.189786:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175416.189789:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.189793:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145315456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175416.189799:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145315584:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175416.189818:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175416.189828:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe67100 x1872931145315584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175416.189841:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145315584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175416.189849:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175416.189853:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.189856:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145315584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175416.189876:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145315712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175416.189892:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175416.189926:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe67480 x1872931145315712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175416.189939:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145315712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175416.189947:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175416.189951:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.189954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145315712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175416.189960:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145315840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175416.189977:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175416.189987:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175416/real 1786175416]  req@ffff89d99fe64000 x1872931145315840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175416.189999:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145315840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175416.190007:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175416.190010:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175416.190014:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145315840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175416.701003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175416.701062:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175417.212978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175417.724995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175417.725081:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175418.236983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175418.749027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175418.749108:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175419.261008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175419.773027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175419.773109:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175420.285063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175420.797017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175420.797084:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175421.308989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175421.308999:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175421.309003:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175421.309014:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9155
00000100:00080000:3.0:1786175421.309023:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309030:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175421.309067:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145315968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175421.309075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175421.309106:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175421.309110:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175421.309113:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175421.309117:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9155
00000100:00080000:3.0:1786175421.309120:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309123:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175421.309131:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175421.309144:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145316096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175421.309153:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175421.309157:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145315968:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175421.309157:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175421.309160:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175421.309167:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9155
00000100:00080000:3.0:1786175421.309170:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309172:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175421.309175:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175421.309183:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145316224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175421.309189:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175421.309192:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175421.309194:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175421.309196:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9155
00000100:00080000:3.0:1786175421.309199:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309202:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175421.309205:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175421.309213:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145316352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175421.309225:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175421.309228:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175421.309229:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175421.309231:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9155
00000800:00000100:0.0:1786175421.309243:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175421.309243:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309250:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175421.309253:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175421.309262:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145316480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175421.309269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175421.309271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175421.309273:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175421.309275:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9155
00000100:00080000:3.0:1786175421.309277:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309280:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175421.309284:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175421.309298:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe65f80 x1872931145315968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175421.309298:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145316608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175421.309335:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175421.309338:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175421.309340:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175421.309343:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145315968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175421.309344:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9155
00000100:00080000:3.0:1786175421.309349:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309355:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175421.309361:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175421.309372:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175421.309373:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145316736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175421.309379:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175421.309394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175421.309398:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145315968:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175421.309399:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175421.309403:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175421.309424:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145316096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175421.309428:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9155
00000100:00080000:3.0:1786175421.309432:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309435:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175421.309438:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175421.309448:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145316864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175421.309453:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175421.309466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175421.309470:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175421.309471:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175421.309475:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe67b80 x1872931145316096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175421.309479:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9155
00000100:00080000:3.0:1786175421.309486:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175421.309491:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175421.309495:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175421.309496:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145316096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175421.309505:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175421.309507:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145316992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175421.309510:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175421.309518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145316096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175421.309530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145316224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175421.309546:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175421.309554:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe65180 x1872931145316224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175421.309562:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145316224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175421.309568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175421.309569:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175421.309571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145316224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175421.309586:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145316352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175421.309597:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175421.309603:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe67800 x1872931145316352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175421.309610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145316352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175421.309622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175421.309624:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175421.309626:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145316352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175421.309631:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145316480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175421.309657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175421.309663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe64380 x1872931145316480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175421.309670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145316480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175421.309680:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175421.309682:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175421.309684:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145316480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175421.309687:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145316608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175421.309697:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175421.309702:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe66d80 x1872931145316608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175421.309709:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145316608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175421.309727:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175421.309730:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175421.309733:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145316608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175421.309737:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145316736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175421.309751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175421.309758:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe66680 x1872931145316736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175421.309766:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145316736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175421.309771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175421.309773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175421.309776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145316736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175421.309790:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145316864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175421.309800:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175421.309806:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe65f80 x1872931145316864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175421.309814:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145316864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175421.309819:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175421.309820:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175421.309822:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145316864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175421.309825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145316992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175421.309835:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175421.309840:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175421/real 1786175421]  req@ffff89d99fe64000 x1872931145316992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175421.309847:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145316992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175421.309852:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175421.309854:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175421.309856:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145316992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175421.821010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175421.821190:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175422.333052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175422.844996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175422.845109:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175423.357018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175423.868998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175423.869072:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175424.380976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175424.893024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175424.893090:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175425.405061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175425.916988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175425.917077:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175426.428970:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175426.428979:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175426.428983:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.428993:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429003:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175426.429010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175426.429010:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175426.429044:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145317120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175426.429069:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175426.429072:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175426.429073:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.429076:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429078:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175426.429080:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175426.429088:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175426.429097:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145317248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175426.429106:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175426.429108:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175426.429110:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.429113:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429115:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175426.429117:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175426.429120:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175426.429126:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145317120:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175426.429131:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145317376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175426.429140:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175426.429142:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175426.429143:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.429146:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429148:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175426.429150:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175426.429153:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175426.429162:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145317504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175426.429168:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175426.429171:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175426.429172:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.429175:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429178:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175426.429180:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175426.429184:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175426.429193:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145317632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175426.429197:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175426.429209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175426.429214:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175426.429217:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.429222:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429237:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175426.429242:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175426.429247:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175426.429261:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe67480 x1872931145317120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175426.429262:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145317760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175426.429287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175426.429293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175426.429295:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.429300:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429305:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175426.429306:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145317120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175426.429314:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175426.429332:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175426.429337:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.429344:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175426.429346:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145317888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175426.429353:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145317120:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175426.429370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175426.429372:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145317248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175426.429375:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175426.429379:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.429384:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429386:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175426.429389:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175426.429392:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175426.429401:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145318016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175426.429407:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175426.429413:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175426.429413:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175426.429416:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175426.429421:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9160
00000100:00080000:3.0:1786175426.429424:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175426.429427:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175426.429430:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175426.429438:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe67100 x1872931145317248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175426.429440:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145318144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175426.429471:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145317248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175426.429482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.429487:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175426.429492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145317248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175426.429516:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145317376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175426.429538:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175426.429550:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe66a00 x1872931145317376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175426.429569:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145317376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175426.429579:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.429583:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175426.429586:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145317376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175426.429594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145317504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175426.429616:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175426.429630:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe66300 x1872931145317504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175426.429643:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145317504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175426.429652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.429656:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175426.429660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145317504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175426.429683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145317632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175426.429706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175426.429720:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe64a80 x1872931145317632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175426.429732:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145317632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175426.429758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.429762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175426.429766:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145317632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175426.429773:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145317760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175426.429796:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175426.429809:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe65880 x1872931145317760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175426.429822:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145317760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175426.429831:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.429834:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175426.429838:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145317760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175426.429844:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145317888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175426.429865:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175426.429878:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe65500 x1872931145317888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175426.429891:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145317888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175426.429927:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.429931:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175426.429935:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145317888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175426.429942:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145318016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175426.429963:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175426.429977:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe64700 x1872931145318016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175426.429989:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145318016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175426.429998:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.430001:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175426.430015:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145318016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175426.430022:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145318144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175426.430044:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175426.430056:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175426/real 1786175426]  req@ffff89d99fe64000 x1872931145318144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175426.430069:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145318144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175426.430078:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175426.430082:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175426.430085:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145318144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175426.941075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175426.941084:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175427.453034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:2.0:1786175427.965024:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175427.965071:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175428.477026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175428.989022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175428.989218:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175429.501085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175430.013093:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175430.013249:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175430.525026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175431.037041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175431.037154:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175431.549050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175431.549053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175431.549082:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175431.549087:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175431.549098:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549108:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175431.549116:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175431.549157:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145318272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175431.549193:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175431.549197:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175431.549199:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175431.549203:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549206:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175431.549209:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175431.549236:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175431.549249:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145318400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175431.549260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175431.549264:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175431.549266:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175431.549271:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549276:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175431.549279:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145318272:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175431.549284:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175431.549296:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175431.549325:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145318528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175431.549336:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175431.549340:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175431.549341:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175431.549345:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549351:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175431.549355:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175431.549360:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175431.549373:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145318656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175431.549386:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175431.549387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175431.549394:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175431.549396:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175431.549401:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549405:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175431.549408:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175431.549413:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175431.549424:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145318784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175431.549433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175431.549436:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175431.549439:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175431.549442:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549447:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175431.549451:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175431.549457:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175431.549459:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87c380 x1872931145318272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175431.549479:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145318912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175431.549488:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145318272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175431.549529:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.549535:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175431.549535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175431.549548:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786175431.549549:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145318272:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175431.549556:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175431.549564:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145318400:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175431.549570:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549595:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175431.549602:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175431.549610:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175431.549638:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175431.549656:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145319040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175431.549664:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87c700 x1872931145318400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175431.549697:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175431.549703:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175431.549706:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175431.549718:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549725:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175431.549729:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145318400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175431.549737:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175431.549753:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175431.549758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.549769:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175431.549778:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145319168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175431.549779:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145318400:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175431.549817:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175431.549822:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175431.549825:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175431.549830:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9165
00000100:00080000:2.0:1786175431.549835:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175431.549839:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175431.549845:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175431.549850:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145318528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175431.549863:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145319296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175431.549906:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175431.549973:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87c000 x1872931145318528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175431.549994:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145318528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175431.550003:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.550006:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175431.550010:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145318528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175431.550017:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145318656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175431.550039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175431.550052:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87dc00 x1872931145318656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175431.550087:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145318656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175431.550099:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.550104:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175431.550109:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145318656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175431.550118:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145318784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175431.550149:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175431.550164:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87f800 x1872931145318784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175431.550176:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145318784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175431.550190:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.550193:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175431.550196:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145318784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175431.550201:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145318912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175431.550238:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175431.550248:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87df80 x1872931145318912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175431.550259:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145318912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175431.550268:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.550270:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175431.550273:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145318912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175431.550279:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145319040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175431.550294:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175431.550303:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87d500 x1872931145319040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175431.550314:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145319040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175431.550338:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.550340:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175431.550344:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145319040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175431.550349:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145319168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175431.550366:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175431.550381:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87f100 x1872931145319168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175431.550398:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145319168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175431.550411:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.550415:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175431.550420:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145319168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175431.550451:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145319296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175431.550474:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175431.550485:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175431/real 1786175431]  req@ffff89d99e87d880 x1872931145319296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175431.550497:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145319296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175431.550505:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175431.550508:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175431.550511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145319296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175432.061003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175432.061068:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175432.573043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175433.084999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175433.085053:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175433.596974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175434.109015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175434.109073:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175434.621022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175435.132994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175435.133018:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175435.644996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175436.156993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175436.157026:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175436.669013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175436.669016:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669031:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175436.669037:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175436.669050:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669065:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175436.669074:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175436.669143:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145319424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175436.669187:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175436.669192:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175436.669194:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669197:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175436.669200:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175436.669208:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175436.669220:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145319552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175436.669228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669232:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175436.669234:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175436.669237:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669239:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175436.669250:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175436.669252:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145319424:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786175436.669256:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175436.669290:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145319680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175436.669299:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669302:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175436.669303:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175436.669306:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669308:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175436.669310:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175436.669314:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175436.669323:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145319808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175436.669328:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669331:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175436.669332:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175436.669335:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669338:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175436.669340:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175436.669354:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175436.669360:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145319936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175436.669366:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669368:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175436.669369:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175436.669371:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669374:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175436.669376:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175436.669378:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175436.669386:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145320064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175436.669391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669393:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175436.669394:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175436.669396:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669399:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175436.669411:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175436.669411:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175436.669424:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175436.669433:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145320192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175436.669441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669444:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175436.669452:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175436.669456:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669459:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175436.669462:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175436.669466:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175436.669475:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145320320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175436.669483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175436.669486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175436.669488:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175436.669498:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87ca80 x1872931145319424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175436.669498:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9170
00000100:00080000:2.0:1786175436.669508:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175436.669516:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175436.669531:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175436.669541:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145320448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175436.669591:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145319424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.669629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.669634:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.669639:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145319424:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175436.669651:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145319552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175436.669689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175436.669707:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87e680 x1872931145319552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175436.669721:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145319552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.669729:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.669733:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.669745:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145319552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175436.669788:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145319680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175436.669839:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175436.669850:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87ed80 x1872931145319680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175436.669861:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145319680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.669868:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.669871:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.669873:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145319680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175436.669878:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145319808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175436.669894:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175436.669959:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87d880 x1872931145319808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175436.669977:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145319808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.669984:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.669991:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.669997:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145319808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175436.670011:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145319936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175436.670069:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175436.670099:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87f100 x1872931145319936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175436.670118:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145319936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.670142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.670148:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.670153:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145319936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175436.670180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145320064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175436.670219:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175436.670229:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87d500 x1872931145320064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175436.670238:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145320064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.670245:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.670248:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.670250:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145320064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175436.670254:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145320192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175436.670267:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175436.670275:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87df80 x1872931145320192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175436.670284:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145320192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.670290:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.670292:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.670296:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145320192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175436.670301:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145320320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175436.670314:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175436.670323:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87f800 x1872931145320320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175436.670331:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145320320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.670338:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.670340:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.670342:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145320320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175436.670347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145320448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175436.670359:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175436.670366:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175436/real 1786175436]  req@ffff89d99e87dc00 x1872931145320448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175436.670379:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145320448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175436.670386:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175436.670389:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175436.670392:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145320448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175437.181003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175437.181061:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175437.692978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175438.205041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175438.205141:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175438.717002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175439.229008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175439.229080:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175439.741003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175440.253009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175440.253116:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175440.765084:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175441.277005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175441.277089:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175441.789024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175441.789068:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175441.789074:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175441.789078:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789087:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789096:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789102:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175441.789156:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145320576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175441.789184:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175441.789188:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175441.789189:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789193:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789212:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789217:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175441.789225:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175441.789236:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145320704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175441.789244:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175441.789247:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175441.789249:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789252:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789254:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789257:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175441.789260:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175441.789270:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145320832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175441.789274:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145320576:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175441.789279:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175441.789288:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175441.789293:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789298:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789300:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789302:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175441.789305:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175441.789324:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145320960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175441.789331:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175441.789334:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175441.789335:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789337:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789340:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789343:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175441.789346:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175441.789354:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145321088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175441.789360:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175441.789362:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175441.789363:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789365:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789368:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789371:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175441.789374:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175441.789383:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145321216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175441.789390:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175441.789394:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175441.789402:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175441.789404:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789408:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789410:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789414:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175441.789417:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175441.789425:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145321344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175441.789436:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175441.789439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175441.789440:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789444:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789446:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789468:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175441.789473:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175441.789482:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe65f80 x1872931145320576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175441.789484:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145321472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175441.789556:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175441.789559:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175441.789566:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175441.789576:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9176
00000100:00080000:3.0:1786175441.789583:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175441.789588:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175441.789595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145320576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175441.789595:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175441.789622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175441.789623:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145321600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175441.789641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.789651:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145320576:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175441.789665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145320704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175441.789696:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175441.789712:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe66680 x1872931145320704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175441.789727:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145320704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175441.789738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175441.789742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.789746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145320704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175441.789791:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145320832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175441.789814:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175441.789827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe66d80 x1872931145320832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175441.789849:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145320832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175441.789859:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175441.789863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.789867:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145320832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175441.789874:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145320960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175441.789928:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175441.789943:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe64380 x1872931145320960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175441.789967:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145320960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175441.789976:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175441.789980:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.789984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145320960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175441.789992:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145321088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175441.790014:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175441.790027:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe67800 x1872931145321088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175441.790041:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145321088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175441.790057:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175441.790061:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.790064:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145321088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175441.790072:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145321216:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175441.790093:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175441.790105:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe65180 x1872931145321216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175441.790119:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145321216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175441.790128:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175441.790131:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.790135:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145321216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175441.790142:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145321344:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175441.790164:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175441.790186:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe67b80 x1872931145321344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175441.790199:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145321344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175441.790208:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175441.790211:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.790216:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145321344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175441.790223:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145321472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175441.790245:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175441.790258:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe64000 x1872931145321472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175441.790271:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145321472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175441.790280:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175441.790284:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.790288:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145321472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175441.790295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145321600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175441.790315:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175441.790328:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175441/real 1786175441]  req@ffff89d99fe64700 x1872931145321600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175441.790342:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145321600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175441.790351:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175441.790354:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175441.790359:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145321600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175442.300981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175442.301028:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175442.812990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175443.324994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175443.325061:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175443.837002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175444.349027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175444.349095:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175444.861020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175445.372963:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175445.373066:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175445.884962:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175446.396983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175446.397065:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175446.908959:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175446.908968:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175446.908972:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.908981:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:3.0:1786175446.908990:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175446.908997:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175446.908998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786175446.909032:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145321728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175446.909053:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175446.909055:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175446.909057:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.909059:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:3.0:1786175446.909062:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175446.909064:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175446.909071:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175446.909080:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145321856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175446.909087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175446.909089:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175446.909091:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.909093:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:3.0:1786175446.909096:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175446.909098:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175446.909102:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175446.909106:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145321728:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175446.909111:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145321984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175446.909121:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175446.909123:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175446.909124:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.909126:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:3.0:1786175446.909128:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175446.909130:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175446.909133:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175446.909141:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145322112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175446.909147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175446.909150:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175446.909152:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.909156:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:3.0:1786175446.909160:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175446.909164:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175446.909169:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175446.909190:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175446.909192:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145322240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175446.909204:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175446.909208:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175446.909211:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.909215:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:3.0:1786175446.909220:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175446.909224:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175446.909229:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175446.909231:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe65500 x1872931145321728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175446.909240:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145322368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175446.909249:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175446.909250:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145321728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175446.909257:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175446.909260:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.909267:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:0.0:1786175446.909269:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175446.909270:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175446.909277:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175446.909278:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175446.909283:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175446.909284:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145321728:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175446.909293:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145322496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175446.909295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145321856:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175446.909307:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175446.909310:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175446.909311:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.909315:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:3.0:1786175446.909318:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175446.909323:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175446.909323:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175446.909329:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175446.909338:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe65880 x1872931145321856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175446.909341:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145322624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175446.909362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175446.909364:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145321856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175446.909367:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175446.909370:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175446.909379:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9181
00000100:00080000:0.0:1786175446.909381:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175446.909382:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175446.909389:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175446.909390:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175446.909396:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175446.909397:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145321856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175446.909407:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145322752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175446.909423:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145321984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175446.909437:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175446.909444:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe64a80 x1872931145321984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175446.909456:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145321984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175446.909461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175446.909463:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175446.909465:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145321984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175446.909484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145322112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175446.909499:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175446.909508:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe66300 x1872931145322112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175446.909520:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145322112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175446.909528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175446.909531:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175446.909535:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145322112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175446.909552:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145322240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175446.909571:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175446.909579:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe66a00 x1872931145322240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175446.909587:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145322240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175446.909597:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175446.909599:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175446.909601:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145322240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175446.909604:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145322368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175446.909615:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175446.909620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe67100 x1872931145322368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175446.909627:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145322368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175446.909633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175446.909634:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175446.909636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145322368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175446.909639:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145322496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175446.909648:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175446.909653:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe67480 x1872931145322496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175446.909660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145322496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175446.909665:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175446.909667:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175446.909669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145322496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175446.909673:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145322624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175446.909682:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175446.909688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe64700 x1872931145322624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175446.909694:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145322624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175446.909700:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175446.909701:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175446.909703:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145322624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175446.909715:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145322752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175446.909725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175446.909731:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175446/real 1786175446]  req@ffff89d99fe64000 x1872931145322752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175446.909738:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145322752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175446.909743:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175446.909744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175446.909746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145322752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175447.420974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175447.421025:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175447.933032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175448.445017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175448.445121:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175448.956996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175449.469019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175449.469041:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175449.980999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175450.493081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175450.493117:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175451.005010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175451.516991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175451.517054:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175452.029045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175452.029064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175452.029078:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175452.029084:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175452.029098:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9186
00000100:00080000:3.0:1786175452.029112:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175452.029122:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175452.029209:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145322880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175452.029246:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175452.029251:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175452.029254:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175452.029259:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9186
00000100:00080000:3.0:1786175452.029263:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175452.029268:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175452.029282:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175452.029309:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145323008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175452.029323:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175452.029334:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145322880:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175452.029335:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175452.029343:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175452.029362:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9186
00000100:00080000:3.0:1786175452.029366:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175452.029370:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175452.029375:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175452.029391:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145323136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175452.029401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175452.029406:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175452.029409:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175452.029414:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9186
00000800:00000100:0.0:1786175452.029485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175452.029489:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175452.029500:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175452.029510:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175452.029547:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145323264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175452.029564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175452.029565:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe67b80 x1872931145322880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175452.029593:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175452.029604:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175452.029625:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9186
00000100:00100000:0.0:1786175452.029634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145322880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175452.029638:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175452.029681:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175452.029685:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175452.029693:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175452.029696:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175452.029700:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145322880:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175452.029733:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145323392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175452.029756:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145323008:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175452.029789:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175452.029794:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175452.029797:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175452.029807:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9186
00000800:00000100:0.0:1786175452.029810:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175452.029821:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175452.029831:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175452.029837:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe65180 x1872931145323008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175452.029864:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145323008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175452.029866:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175452.029886:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175452.029891:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175452.029895:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145323008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175452.029908:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145323136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175452.029909:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145323520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175452.029930:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175452.029948:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe67800 x1872931145323136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175452.029962:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175452.029968:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175452.029971:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175452.029977:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9186
00000100:00080000:3.0:1786175452.029983:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175452.029988:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175452.029996:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175452.030010:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145323136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175452.030019:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175452.030028:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145323648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175452.030029:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175452.030039:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145323136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175452.030061:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145323264:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175452.030084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175452.030089:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175452.030092:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175452.030100:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9186
00000800:00000100:0.0:1786175452.030103:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175452.030115:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175452.030124:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe64380 x1872931145323264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175452.030125:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175452.030144:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175452.030152:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145323264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175452.030164:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175452.030165:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145323776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175452.030177:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175452.030198:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145323264:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175452.030231:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175452.030237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175452.030240:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175452.030251:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145323392:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175452.030251:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9186
00000100:00080000:3.0:1786175452.030268:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175452.030277:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175452.030302:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175452.030304:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175452.030336:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145323904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175452.030341:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe66d80 x1872931145323392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175452.030398:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145323392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175452.030445:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175452.030452:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175452.030457:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145323392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175452.030492:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145323520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175452.030517:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175452.030526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe66680 x1872931145323520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175452.030535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145323520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175452.030542:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175452.030545:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175452.030547:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145323520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175452.030551:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145323648:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175452.030563:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175452.030570:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe65f80 x1872931145323648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175452.030579:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145323648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175452.030585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175452.030587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175452.030590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145323648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175452.030595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145323776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175452.030607:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175452.030614:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe67b80 x1872931145323776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175452.030623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145323776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175452.030629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175452.030631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175452.030634:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145323776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175452.030648:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145323904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175452.030661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175452.030668:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175452/real 1786175452]  req@ffff89d99fe64000 x1872931145323904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175452.030678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145323904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175452.030684:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175452.030686:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175452.030688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145323904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175452.541056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175452.541159:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175453.052976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175453.565015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175453.565110:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175454.077002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175454.589046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175454.589151:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175455.101015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175455.613039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175455.613111:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175456.125065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:2.0:1786175456.637069:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175456.637073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175457.149035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175457.149064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149073:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175457.149079:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149092:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00080000:3.0:1786175457.149105:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175457.149117:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175457.149175:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145324032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175457.149223:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149228:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175457.149230:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149235:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00080000:3.0:1786175457.149240:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175457.149246:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175457.149258:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175457.149277:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145324160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175457.149292:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149295:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175457.149297:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149305:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00080000:3.0:1786175457.149319:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175457.149321:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145324032:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175457.149329:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175457.149353:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175457.149410:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145324288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175457.149422:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149426:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175457.149428:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149434:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00080000:3.0:1786175457.149440:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175457.149444:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175457.149451:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175457.149465:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145324416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175457.149475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149490:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175457.149493:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149502:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00080000:3.0:1786175457.149508:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175457.149513:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175457.149518:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175457.149534:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145324544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175457.149555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149559:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175457.149562:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149569:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00080000:3.0:1786175457.149572:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175457.149577:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175457.149584:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175457.149589:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145324160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175457.149604:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145324672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175457.149622:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149627:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175457.149630:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149635:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00080000:3.0:1786175457.149643:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175457.149649:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175457.149656:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175457.149674:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145324800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175457.149680:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145324288:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175457.149720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175457.149732:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149738:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00080000:3.0:1786175457.149750:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175457.149758:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145324416:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175457.149759:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175457.149779:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175457.149798:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145324928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175457.149809:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175457.149813:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175457.149815:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175457.149827:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9191
00000100:00100000:0.0:1786175457.149829:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145324544:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175457.149831:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175457.149847:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175457.149863:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175457.149880:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145325056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175457.149968:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145324672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175457.150024:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145324800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175457.150089:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145324928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175457.150137:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145325056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175457.660976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175457.661033:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175458.173014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175458.685069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175458.685118:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175459.196990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175459.709009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175459.709053:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175460.220972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:3.0:1786175460.221185:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:3.0:1786175460.221220:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1786175460.221233:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175460.221273:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:3.0:1786175460.221283:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175460.221293:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175460.221302:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175460.221313:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786175460.221325:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175460.221329:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe64000 x1872931145325056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786175460.221368:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175460.221375:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145325056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786175460.221386:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786175460.221398:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221404:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221410:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145325056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175460.221419:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe67480 x1872931145324160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175460.221433:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145324160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175460.221441:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221445:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145324160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175460.221455:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe67100 x1872931145324288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175460.221466:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145324288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175460.221474:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221478:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145324288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175460.221488:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe66a00 x1872931145324416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175460.221501:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145324416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175460.221508:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221511:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221514:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145324416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175460.221521:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe66300 x1872931145324544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175460.221534:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145324544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175460.221541:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221544:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221547:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145324544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175460.221554:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe64700 x1872931145324032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175460.221565:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145324032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175460.221572:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221575:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221578:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145324032:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175460.221605:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe64a80 x1872931145324672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175460.221616:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145324672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175460.221623:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221625:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145324672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175460.221634:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe65880 x1872931145324800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175460.221643:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145324800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175460.221651:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145324800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175460.221663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175457/real 1786175460]  req@ffff89d99fe65500 x1872931145324928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175460.221674:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145324928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175460.221682:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175460.221685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175460.221688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145324928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175460.732992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175460.733060:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175461.245012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175461.757017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175461.757108:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175462.269016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175462.269085:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175462.269092:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175462.269096:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175462.269105:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00080000:0.0:1786175462.269114:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175462.269120:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175462.269161:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145325184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175462.269199:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175462.269204:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175462.269207:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175462.269214:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00080000:0.0:1786175462.269221:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175462.269227:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175462.269237:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145325184:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786175462.269238:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175462.269258:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145325312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175462.269274:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175462.269279:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175462.269281:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175462.269287:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00080000:0.0:1786175462.269293:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175462.269298:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175462.269304:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175462.269345:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175462.269363:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145325440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175462.269378:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175462.269383:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175462.269385:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175462.269396:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f2680 x1872931145325184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175462.269398:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00080000:0.0:1786175462.269409:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175462.269419:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175462.269428:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175462.269431:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145325184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175462.269447:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175462.269454:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175462.269459:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145325568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175462.269464:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145325184:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175462.269484:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175462.269488:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175462.269490:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175462.269495:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00080000:0.0:1786175462.269500:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175462.269502:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145325312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175462.269511:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175462.269520:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175462.269540:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145325696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175462.269548:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175462.269563:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175462.269568:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175462.269570:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175462.269577:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f1500 x1872931145325312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175462.269580:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00080000:0.0:1786175462.269589:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175462.269599:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175462.269607:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145325312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175462.269608:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175462.269626:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175462.269632:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145325824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175462.269647:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175462.269651:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175462.269653:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175462.269656:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175462.269663:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00100000:2.0:1786175462.269667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145325312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175462.269672:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175462.269683:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175462.269683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145325440:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175462.269696:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175462.269715:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145325952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175462.269729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175462.269730:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175462.269746:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175462.269748:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175462.269754:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00080000:0.0:1786175462.269759:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175462.269764:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175462.269769:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f0700 x1872931145325440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175462.269773:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175462.269794:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145326080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175462.269799:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145325440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175462.269827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175462.269834:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175462.269834:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175462.269845:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786175462.269846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145325440:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175462.269853:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175462.269862:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145325568:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175462.269863:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9196
00000100:00080000:0.0:1786175462.269874:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175462.269882:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175462.269889:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175462.269936:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175462.269955:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f2d80 x1872931145325568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175462.269975:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145326208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175462.269978:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145325568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175462.270015:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175462.270025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175462.270035:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145325568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175462.270069:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145325696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175462.270098:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175462.270112:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f2a00 x1872931145325696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175462.270128:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145325696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175462.270137:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175462.270140:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175462.270145:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145325696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175462.270152:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145325824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175462.270177:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175462.270192:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f3480 x1872931145325824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175462.270207:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145325824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175462.270216:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175462.270220:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175462.270224:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145325824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175462.270231:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145325952:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175462.270254:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175462.270279:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f3100 x1872931145325952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175462.270292:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145325952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175462.270301:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175462.270305:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175462.270308:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145325952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175462.270316:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145326080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175462.270370:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175462.270387:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f0e00 x1872931145326080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175462.270412:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145326080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175462.270423:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175462.270428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175462.270435:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145326080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175462.270444:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145326208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175462.270470:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175462.270486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175462/real 1786175462]  req@ffff89d9870f1880 x1872931145326208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175462.270501:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145326208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175462.270512:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175462.270517:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175462.270521:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145326208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175462.781019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175462.781095:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175463.293020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175463.805060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175463.805067:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175464.316984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175464.829062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175464.829130:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175465.341102:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175465.852988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175465.853072:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175466.365027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175466.877014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175466.877041:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175467.388996:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389005:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175467.389010:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175467.389011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175467.389020:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389029:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175467.389036:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175467.389072:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145326336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175467.389095:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389097:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175467.389099:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175467.389101:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389104:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175467.389106:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175467.389114:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175467.389122:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145326464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175467.389130:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389133:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175467.389134:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175467.389139:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145326336:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175467.389140:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389144:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175467.389149:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175467.389152:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175467.389160:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145326592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175467.389166:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389169:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175467.389170:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175467.389173:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389175:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175467.389179:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175467.389182:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175467.389189:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145326720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175467.389194:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389197:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175467.389198:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175467.389203:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175467.389204:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389210:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175467.389213:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175467.389215:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175467.389223:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145326848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175467.389229:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389232:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175467.389233:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175467.389236:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389238:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175467.389241:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175467.389244:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175467.389252:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145326976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175467.389257:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f1180 x1872931145326336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175467.389260:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389265:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175467.389280:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175467.389286:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389292:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175467.389298:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175467.389302:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175467.389308:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145326336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175467.389313:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145327104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175467.389323:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175467.389325:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389329:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175467.389331:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175467.389332:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175467.389336:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389341:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175467.389342:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145326336:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175467.389348:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175467.389355:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175467.389368:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145327232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175467.389374:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145326464:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175467.389385:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175467.389390:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175467.389392:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175467.389398:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9201
00000100:00080000:0.0:1786175467.389402:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175467.389406:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175467.389411:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175467.389412:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175467.389429:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145327360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175467.389433:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f0a80 x1872931145326464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175467.389464:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145326464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175467.389473:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175467.389478:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175467.389482:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145326464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175467.389488:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145326592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175467.389512:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175467.389526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f3b80 x1872931145326592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175467.389536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145326592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175467.389545:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175467.389549:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175467.389552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145326592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175467.389559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145326720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175467.389582:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175467.389593:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f1880 x1872931145326720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175467.389601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145326720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175467.389611:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175467.389614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175467.389616:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145326720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175467.389620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145326848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175467.389633:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175467.389639:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f0e00 x1872931145326848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175467.389647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145326848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175467.389652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175467.389654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175467.389656:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145326848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175467.389659:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145326976:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175467.389669:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175467.389674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f3100 x1872931145326976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175467.389681:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145326976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175467.389686:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175467.389688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175467.389690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145326976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175467.389693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145327104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175467.389706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175467.389711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f3480 x1872931145327104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175467.389718:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145327104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175467.389722:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175467.389724:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175467.389726:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145327104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175467.389741:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145327232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175467.389751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175467.389757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f2a00 x1872931145327232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175467.389764:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145327232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175467.389769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175467.389771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175467.389773:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145327232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175467.389776:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145327360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175467.389786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175467.389792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175467/real 1786175467]  req@ffff89d9870f2d80 x1872931145327360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175467.389799:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145327360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175467.389805:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175467.389806:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175467.389808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145327360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175467.901018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175467.901133:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175468.412975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175468.925007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175468.925120:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175469.437004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175469.949043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175469.949119:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175470.460988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175470.972999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175470.973021:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175471.484977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175471.997015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175471.997018:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175472.509005:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175472.509016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175472.509017:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175472.509023:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509037:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509047:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509055:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175472.509101:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145327488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175472.509131:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175472.509136:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175472.509138:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509143:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509148:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509154:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175472.509165:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175472.509179:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145327488:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175472.509183:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145327616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175472.509200:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175472.509204:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175472.509206:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509212:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509217:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509235:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175472.509241:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175472.509259:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145327744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175472.509260:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175472.509294:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175472.509299:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175472.509302:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509308:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509313:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509318:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175472.509324:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175472.509339:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145327872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175472.509350:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175472.509354:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175472.509356:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509361:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509365:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509369:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175472.509375:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175472.509376:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87c000 x1872931145327488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175472.509392:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145328000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175472.509395:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145327488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175472.509421:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175472.509421:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.509427:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175472.509429:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786175472.509433:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145327488:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175472.509435:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509443:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509447:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509452:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175472.509455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145327616:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175472.509460:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175472.509488:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145328128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175472.509490:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175472.509503:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87c700 x1872931145327616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175472.509506:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175472.509510:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175472.509512:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509517:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509521:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509525:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175472.509532:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175472.509546:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145328256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175472.509556:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175472.509560:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175472.509562:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509567:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509571:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509576:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175472.509581:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175472.509595:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145328384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175472.509626:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175472.509631:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175472.509634:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175472.509640:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9206
00000100:00080000:2.0:1786175472.509645:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175472.509649:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175472.509655:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175472.509663:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145327616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175472.509672:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145328512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175472.509673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.509682:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175472.509690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145327616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175472.509697:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145327744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175472.509716:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175472.509725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87c380 x1872931145327744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175472.509733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145327744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175472.509739:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.509741:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175472.509743:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145327744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175472.509746:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145327872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175472.509767:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175472.509773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87dc00 x1872931145327872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175472.509780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145327872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175472.509789:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.509791:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175472.509793:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145327872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175472.509797:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145328000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175472.509806:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175472.509812:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87f800 x1872931145328000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175472.509818:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145328000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175472.509823:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.509825:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175472.509827:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145328000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175472.509838:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145328128:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175472.509849:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175472.509855:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87df80 x1872931145328128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175472.509862:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145328128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175472.509867:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.509868:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175472.509871:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145328128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175472.509875:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145328256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175472.509884:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175472.509890:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87d500 x1872931145328256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175472.509926:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145328256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175472.509935:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.509939:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175472.509943:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145328256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175472.509951:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145328384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175472.509973:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175472.509983:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87f100 x1872931145328384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175472.509991:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145328384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175472.509997:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.509999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175472.510001:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145328384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175472.510005:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145328512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175472.510015:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175472.510024:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175472/real 1786175472]  req@ffff89d99e87d880 x1872931145328512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175472.510035:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145328512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175472.510044:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175472.510047:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175472.510051:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145328512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175473.020999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175473.021071:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175473.533009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175474.044980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175474.045084:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175474.556988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175475.068968:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175475.069066:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175475.581015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175476.093026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175476.093129:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175476.605053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175477.117026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175477.117137:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175477.629073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175477.629091:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175477.629102:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175477.629120:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629134:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629147:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175477.629156:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175477.629242:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145328640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175477.629271:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175477.629275:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175477.629278:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629282:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629287:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175477.629292:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175477.629302:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175477.629319:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145328768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175477.629321:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145328640:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175477.629343:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175477.629347:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175477.629349:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629354:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629358:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175477.629361:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175477.629366:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175477.629379:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145328896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175477.629389:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175477.629393:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175477.629395:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629398:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629402:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175477.629410:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175477.629415:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175477.629416:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175477.629429:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145329024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175477.629440:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175477.629443:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175477.629445:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629448:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629452:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175477.629455:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175477.629460:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175477.629469:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe67b80 x1872931145328640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175477.629473:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145329152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175477.629516:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175477.629520:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175477.629522:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629529:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629533:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175477.629534:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145328640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175477.629539:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175477.629548:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175477.629561:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175477.629564:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145329280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175477.629571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175477.629586:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175477.629587:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145328640:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175477.629593:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175477.629598:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629606:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629609:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175477.629613:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175477.629617:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175477.629625:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145329408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175477.629635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145328768:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175477.629639:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175477.629646:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175477.629651:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629656:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629659:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175477.629663:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175477.629668:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175477.629681:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145329536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175477.629691:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175477.629693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175477.629696:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175477.629704:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175477.629712:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9211
00000100:00080000:3.0:1786175477.629720:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175477.629723:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe65f80 x1872931145328768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175477.629731:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175477.629747:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175477.629753:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145328768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175477.629766:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175477.629774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175477.629774:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145329664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175477.629782:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145328768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175477.629800:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145328896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175477.629828:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175477.629838:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe66680 x1872931145328896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175477.629856:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145328896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175477.629863:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175477.629866:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175477.629869:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145328896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175477.629874:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145329024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175477.629890:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175477.629927:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe66d80 x1872931145329024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175477.629939:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145329024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175477.629947:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175477.629950:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175477.629953:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145329024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175477.629959:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145329152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175477.629977:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175477.629986:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe64380 x1872931145329152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175477.629997:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145329152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175477.630010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175477.630013:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175477.630017:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145329152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175477.630021:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145329280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175477.630039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175477.630047:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe67800 x1872931145329280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175477.630076:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145329280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175477.630095:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175477.630098:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175477.630101:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145329280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175477.630122:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145329408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175477.630141:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175477.630150:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe65180 x1872931145329408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175477.630162:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145329408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175477.630194:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175477.630199:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175477.630219:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145329408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175477.630235:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145329536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175477.630256:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175477.630284:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe67b80 x1872931145329536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175477.630297:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145329536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175477.630305:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175477.630308:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175477.630312:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145329536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175477.630317:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145329664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175477.630334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175477.630343:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175477/real 1786175477]  req@ffff89d99fe65500 x1872931145329664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175477.630355:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145329664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175477.630363:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175477.630365:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175477.630368:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145329664:192.168.202.130@tcp:8:kworker.0
00010000:00010000:2.0:1786175478.141076:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175478.141106:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175478.653014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175479.164995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175479.165054:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175479.677074:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175480.189023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175480.189101:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175480.701013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175481.212980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175481.213021:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175481.725072:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175482.237047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175482.237108:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175482.749025:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175482.749037:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175482.749044:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749057:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749070:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175482.749073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175482.749082:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175482.749163:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145329792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175482.749205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175482.749210:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175482.749212:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749217:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749222:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175482.749227:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175482.749238:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175482.749255:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145329920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175482.749268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175482.749273:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175482.749275:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749280:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749284:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175482.749288:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175482.749294:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175482.749315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145329792:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175482.749315:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145330048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175482.749340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175482.749344:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175482.749346:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749351:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749355:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175482.749359:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175482.749366:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175482.749382:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145330176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175482.749412:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175482.749417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175482.749419:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749424:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749430:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175482.749438:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175482.749444:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175482.749455:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175482.749473:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145330304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175482.749485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175482.749489:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175482.749492:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749517:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749522:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175482.749528:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe65880 x1872931145329792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175482.749535:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175482.749547:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175482.749572:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145330432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175482.749583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175482.749591:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145329792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175482.749592:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175482.749598:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749610:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749618:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175482.749628:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175482.749629:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175482.749644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175482.749647:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175482.749658:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145329792:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175482.749675:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145330560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175482.749681:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145329920:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175482.749713:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175482.749721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175482.749726:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749736:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749746:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175482.749748:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175482.749761:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175482.749775:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175482.749784:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe64a80 x1872931145329920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175482.749809:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145329920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175482.749820:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175482.749824:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145330688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175482.749826:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175482.749838:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145329920:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175482.749862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175482.749867:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175482.749871:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175482.749878:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9216
00000100:00080000:3.0:1786175482.749884:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175482.749889:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145330048:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175482.749926:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175482.749936:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175482.749956:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145330816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175482.749995:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175482.750015:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe64700 x1872931145330048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175482.750031:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145330048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175482.750041:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175482.750045:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175482.750049:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145330048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175482.750056:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145330176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175482.750076:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175482.750087:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe66300 x1872931145330176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175482.750100:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145330176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175482.750109:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175482.750112:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175482.750115:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145330176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175482.750150:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145330304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175482.750199:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175482.750214:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe66a00 x1872931145330304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175482.750229:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145330304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175482.750257:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175482.750261:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175482.750265:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145330304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175482.750272:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145330432:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175482.750291:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175482.750302:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe67100 x1872931145330432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175482.750334:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145330432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175482.750343:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175482.750346:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175482.750349:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145330432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175482.750355:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145330560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175482.750376:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175482.750387:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe67480 x1872931145330560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175482.750400:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145330560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175482.750409:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175482.750412:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175482.750416:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145330560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175482.750423:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145330688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175482.750440:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175482.750449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe64000 x1872931145330688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175482.750462:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145330688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175482.750471:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175482.750474:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175482.750477:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145330688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175482.750501:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145330816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175482.750519:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175482.750530:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175482/real 1786175482]  req@ffff89d99fe64a80 x1872931145330816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175482.750544:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145330816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175482.750553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175482.750565:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175482.750585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145330816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175483.261015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175483.261113:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175483.773017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175484.285034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175484.285147:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175484.797011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175485.308993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175485.309022:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175485.821060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175486.332972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175486.333097:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175486.845152:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175487.357035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175487.357135:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175487.868984:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.868993:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175487.868998:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175487.869008:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869019:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175487.869044:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175487.869122:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145330944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175487.869134:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175487.869152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.869156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175487.869157:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175487.869164:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869167:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175487.869171:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175487.869180:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175487.869191:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145331072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175487.869201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.869204:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175487.869205:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175487.869208:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869210:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175487.869215:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175487.869217:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145330944:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175487.869218:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175487.869229:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145331200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175487.869236:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.869238:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175487.869240:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175487.869243:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869245:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175487.869247:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175487.869250:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175487.869260:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145331328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175487.869266:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.869268:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175487.869269:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175487.869272:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869274:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175487.869277:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175487.869279:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175487.869286:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145331456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175487.869293:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175487.869297:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.869301:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175487.869303:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175487.869307:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869309:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175487.869312:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175487.869316:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175487.869324:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145331584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175487.869342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.869344:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175487.869345:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175487.869349:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869351:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175487.869353:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175487.869359:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe65880 x1872931145330944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175487.869359:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175487.869373:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145331712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175487.869385:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145330944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175487.869385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.869395:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175487.869416:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175487.869419:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175487.869425:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175487.869430:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869435:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175487.869436:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145330944:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175487.869441:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175487.869448:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175487.869453:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145331072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175487.869462:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145331840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175487.869470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175487.869473:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175487.869474:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175487.869477:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9222
00000100:00080000:3.0:1786175487.869480:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175487.869485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175487.869492:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175487.869497:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175487.869506:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe65500 x1872931145331072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175487.869508:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145331968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175487.869546:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145331072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175487.869556:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175487.869559:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175487.869563:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145331072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175487.869587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145331200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175487.869609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175487.869621:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe67b80 x1872931145331200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175487.869633:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145331200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175487.869641:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175487.869644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175487.869648:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145331200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175487.869655:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145331328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175487.869675:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175487.869687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe65180 x1872931145331328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175487.869699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145331328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175487.869707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175487.869710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175487.869714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145331328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175487.869720:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145331456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175487.869739:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175487.869749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe67800 x1872931145331456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175487.869761:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145331456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175487.869769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175487.869772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175487.869775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145331456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175487.869781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145331584:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175487.869811:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175487.869824:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe64380 x1872931145331584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175487.869843:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145331584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175487.869852:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175487.869855:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175487.869858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145331584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175487.869864:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145331712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175487.869882:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175487.869894:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe66d80 x1872931145331712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175487.869947:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145331712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175487.869955:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175487.869958:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175487.869961:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145331712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175487.869967:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145331840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175487.869988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175487.870000:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe66680 x1872931145331840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175487.870012:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145331840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175487.870025:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175487.870029:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175487.870032:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145331840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175487.870037:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145331968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175487.870056:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175487.870067:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175487/real 1786175487]  req@ffff89d99fe65f80 x1872931145331968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175487.870100:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145331968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175487.870116:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175487.870118:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175487.870120:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145331968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175488.381013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175488.381200:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175488.893157:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175489.404942:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175489.405196:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175489.917102:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175490.429013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175490.429174:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175490.940982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175491.453012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175491.453074:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175491.964991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175492.477123:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175492.477171:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175492.988997:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175492.989011:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786175492.989013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175492.989017:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175492.989046:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00080000:3.0:1786175492.989061:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175492.989071:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175492.989129:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145332096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175492.989158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175492.989161:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175492.989163:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175492.989167:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00080000:3.0:1786175492.989170:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175492.989173:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175492.989184:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175492.989205:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145332224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175492.989217:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175492.989220:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175492.989225:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175492.989228:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145332096:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175492.989235:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00080000:3.0:1786175492.989251:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175492.989258:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175492.989263:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175492.989287:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145332352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175492.989296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175492.989299:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175492.989301:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175492.989305:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00080000:3.0:1786175492.989309:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175492.989313:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175492.989318:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175492.989327:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145332480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175492.989340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175492.989358:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175492.989359:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175492.989369:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175492.989379:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00080000:3.0:1786175492.989383:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175492.989388:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175492.989392:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175492.989406:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145332608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175492.989426:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175492.989430:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175492.989433:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175492.989437:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00080000:3.0:1786175492.989442:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175492.989446:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe65f80 x1872931145332096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175492.989450:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175492.989467:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175492.989510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145332096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175492.989519:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145332736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175492.989560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175492.989562:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175492.989579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175492.989584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175492.989585:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175492.989604:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00100000:0.0:1786175492.989605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145332096:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175492.989611:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175492.989637:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175492.989644:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175492.989658:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145332224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175492.989660:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145332864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175492.989683:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175492.989686:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175492.989689:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175492.989693:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00080000:3.0:1786175492.989698:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175492.989705:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175492.989712:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175492.989719:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175492.989729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe66680 x1872931145332224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175492.989746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145332992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175492.989847:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175492.989851:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175492.989852:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175492.989856:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9227
00000100:00080000:3.0:1786175492.989859:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175492.989866:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175492.989870:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175492.989882:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145333120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175492.989890:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145332224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175492.989986:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175492.989992:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175492.990001:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145332224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175492.990012:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145332352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175492.990065:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175492.990092:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe66d80 x1872931145332352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175492.990108:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145332352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175492.990120:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175492.990124:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175492.990128:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145332352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175492.990137:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145332480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175492.990163:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175492.990179:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe64380 x1872931145332480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175492.990193:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145332480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175492.990203:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175492.990207:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175492.990211:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145332480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175492.990219:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145332608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175492.990243:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175492.990256:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe67800 x1872931145332608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175492.990286:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145332608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175492.990296:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175492.990300:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175492.990304:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145332608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175492.990312:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145332736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175492.990334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175492.990348:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe65180 x1872931145332736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175492.990378:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145332736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175492.990390:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175492.990395:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175492.990399:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145332736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175492.990440:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145332864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175492.990466:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175492.990480:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe67b80 x1872931145332864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175492.990510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145332864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175492.990521:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175492.990526:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175492.990531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145332864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175492.990540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145332992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175492.990581:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175492.990595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe65500 x1872931145332992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175492.990610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145332992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175492.990635:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175492.990640:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175492.990645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145332992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175492.990653:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145333120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175492.990678:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175492.990694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175492/real 1786175492]  req@ffff89d99fe65880 x1872931145333120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175492.990711:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145333120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175517 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175492.990723:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175492.990727:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175492.990731:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145333120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175493.501124:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175493.501207:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175494.013120:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175494.525057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175494.525135:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175495.036983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175495.549051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175495.549118:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175496.061128:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175496.573035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175496.573132:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175497.085003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175497.597124:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175497.597129:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00080000:3.0:1786175498.109044:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175498.109055:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1786175498.109056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175498.109059:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109068:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00080000:3.0:1786175498.109080:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109090:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175498.109130:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145333248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175498.109154:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175498.109157:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175498.109159:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109162:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00080000:3.0:1786175498.109165:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109167:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175498.109176:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175498.109185:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145333376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175498.109192:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175498.109196:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175498.109197:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109200:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00080000:3.0:1786175498.109201:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109204:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175498.109207:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175498.109210:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145333248:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175498.109217:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145333504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175498.109226:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175498.109228:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175498.109229:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109231:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00080000:3.0:1786175498.109234:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109236:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175498.109239:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175498.109249:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145333632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175498.109255:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175498.109270:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175498.109271:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109274:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00080000:3.0:1786175498.109276:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109278:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175498.109281:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175498.109286:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175498.109291:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145333760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175498.109299:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175498.109301:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175498.109302:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109304:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00080000:3.0:1786175498.109307:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109310:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175498.109313:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175498.109321:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145333888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175498.109338:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe64a80 x1872931145333248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175498.109340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175498.109346:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175498.109350:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109358:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00080000:3.0:1786175498.109362:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109367:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109368:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145333248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175498.109370:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175498.109381:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145334016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175498.109382:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175498.109391:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175498.109395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175498.109398:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145333248:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175498.109400:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175498.109404:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109410:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00100000:0.0:1786175498.109411:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145333376:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175498.109413:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109419:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175498.109423:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175498.109433:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145334144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175498.109438:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109451:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe64000 x1872931145333376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175498.109452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175498.109461:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175498.109465:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175498.109470:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9232
00000100:00100000:0.0:1786175498.109474:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145333376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175498.109475:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175498.109483:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175498.109490:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175498.109491:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175498.109497:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175498.109502:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145333376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175498.109506:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145334272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175498.109527:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145333504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175498.109541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109548:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe67480 x1872931145333504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175498.109556:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145333504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175498.109582:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175498.109584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175498.109586:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145333504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175498.109590:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145333632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175498.109602:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109609:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe67100 x1872931145333632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175498.109617:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145333632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175498.109622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175498.109623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175498.109625:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145333632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175498.109634:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145333760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175498.109650:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe66a00 x1872931145333760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175498.109674:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145333760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175498.109683:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175498.109686:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175498.109690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145333760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175498.109697:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145333888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175498.109714:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109722:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe66300 x1872931145333888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175498.109730:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145333888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175498.109740:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175498.109742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175498.109744:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145333888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175498.109748:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145334016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175498.109758:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109764:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe64700 x1872931145334016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175498.109771:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145334016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175498.109776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175498.109778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175498.109780:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145334016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175498.109784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145334144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175498.109793:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe65880 x1872931145334144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175498.109806:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145334144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175498.109811:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175498.109813:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175498.109815:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145334144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175498.109818:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145334272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175498.109827:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175498.109832:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175498/real 1786175498]  req@ffff89d99fe65500 x1872931145334272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175498.109839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145334272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175498.109844:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175498.109846:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175498.109848:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145334272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175498.621038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175498.621104:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175499.133039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175499.645018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175499.645048:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175500.157016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175500.668974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175500.669057:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175501.181043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175501.693014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175501.693074:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175502.205015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175502.717000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175502.717054:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175503.229009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175503.229025:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175503.229031:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175503.229036:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175503.229044:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9237
00000100:00080000:0.0:1786175503.229052:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175503.229058:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175503.229091:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145334400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175503.229116:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175503.229119:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175503.229120:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175503.229123:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9237
00000100:00080000:0.0:1786175503.229126:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175503.229129:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175503.229137:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175503.229148:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145334400:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175503.229149:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145334528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175503.229192:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175503.229195:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175503.229197:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175503.229203:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9237
00000100:00080000:0.0:1786175503.229207:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175503.229211:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175503.229219:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175503.229235:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145334656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175503.229247:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175503.229251:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175503.229253:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175503.229261:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9237
00000800:00000100:2.0:1786175503.229262:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175503.229268:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175503.229274:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175503.229281:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175503.229297:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145334784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175503.229309:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175503.229314:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175503.229317:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175503.229325:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9237
00000100:00100000:2.0:1786175503.229326:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f0700 x1872931145334400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175503.229330:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175503.229342:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175503.229356:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175503.229382:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145334912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175503.229390:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175503.229394:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145334400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175503.229395:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175503.229399:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175503.229405:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9237
00000100:00080000:0.0:1786175503.229410:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175503.229419:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175503.229424:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175503.229425:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175503.229431:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175503.229434:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145335040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175503.229438:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145334400:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175503.229450:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175503.229453:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175503.229455:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175503.229458:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9237
00000100:00080000:0.0:1786175503.229461:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175503.229465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145334528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175503.229466:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175503.229474:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175503.229485:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145335168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175503.229494:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175503.229498:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175503.229499:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175503.229503:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175503.229509:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9237
00000100:00080000:0.0:1786175503.229512:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175503.229516:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f1500 x1872931145334528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175503.229517:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175503.229523:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175503.229536:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145335296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175503.229537:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145334528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175503.229560:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175503.229568:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175503.229571:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175503.229578:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175503.229579:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9237
00000100:00080000:0.0:1786175503.229586:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175503.229587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175503.229591:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175503.229595:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145334528:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175503.229597:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175503.229605:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145334656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175503.229618:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145335424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175503.229624:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175503.229646:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f2680 x1872931145334656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175503.229656:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145334656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175503.229670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175503.229673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175503.229675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145334656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175503.229680:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145334784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175503.229693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175503.229700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f2d80 x1872931145334784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175503.229708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145334784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175503.229713:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175503.229714:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175503.229717:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145334784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175503.229721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145334912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175503.229731:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175503.229745:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f2a00 x1872931145334912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175503.229752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145334912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175503.229757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175503.229759:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175503.229761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145334912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175503.229764:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145335040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175503.229773:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175503.229779:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f3480 x1872931145335040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175503.229786:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145335040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175503.229791:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175503.229793:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175503.229794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145335040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175503.229808:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145335168:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175503.229818:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175503.229825:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f3100 x1872931145335168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175503.229832:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145335168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175503.229838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175503.229839:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175503.229841:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145335168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175503.229844:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145335296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175503.229854:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175503.229860:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f0e00 x1872931145335296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175503.229867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145335296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175503.229872:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175503.229873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175503.229875:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145335296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175503.229878:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145335424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175503.229887:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175503.229892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175503/real 1786175503]  req@ffff89d9870f1880 x1872931145335424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175503.229917:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145335424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175503.229937:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175503.229939:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175503.229942:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145335424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175503.740988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175503.741050:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175504.252993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175504.765004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175504.765068:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175505.277011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175505.789071:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175505.789162:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175506.301048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175506.812986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175506.813032:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175507.324998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175507.837020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175507.837131:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175508.349009:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175508.349010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175508.349019:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175508.349022:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175508.349030:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00080000:2.0:1786175508.349037:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175508.349053:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175508.349084:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145335552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175508.349106:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175508.349110:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175508.349111:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175508.349115:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00080000:2.0:1786175508.349118:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175508.349122:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175508.349130:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175508.349143:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145335552:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175508.349144:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145335680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175508.349159:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175508.349162:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175508.349165:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175508.349169:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00080000:2.0:1786175508.349173:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175508.349176:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175508.349179:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175508.349189:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145335808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175508.349196:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175508.349199:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175508.349201:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175508.349203:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00080000:2.0:1786175508.349206:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175508.349211:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175508.349214:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175508.349219:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175508.349229:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145335936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175508.349236:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175508.349239:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175508.349241:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175508.349244:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00080000:2.0:1786175508.349247:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175508.349252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87ed80 x1872931145335552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175508.349252:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175508.349258:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175508.349271:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145336064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175508.349275:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145335552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175508.349290:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175508.349294:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175508.349295:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175508.349296:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175508.349301:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175508.349304:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00100000:0.0:1786175508.349309:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145335552:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175508.349311:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175508.349318:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175508.349324:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175508.349335:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145335680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175508.349341:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145336192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175508.349356:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175508.349357:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175508.349362:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175508.349364:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175508.349370:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00080000:2.0:1786175508.349375:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175508.349377:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87e680 x1872931145335680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175508.349382:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175508.349392:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175508.349399:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145335680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175508.349407:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145336320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175508.349409:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175508.349417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175508.349423:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175508.349424:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145335680:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175508.349429:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175508.349432:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175508.349435:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145335808:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175508.349439:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00080000:2.0:1786175508.349442:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175508.349445:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175508.349449:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175508.349456:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175508.349460:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145336448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175508.349468:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175508.349469:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87ca80 x1872931145335808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175508.349475:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175508.349478:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175508.349486:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9242
00000100:00080000:2.0:1786175508.349491:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175508.349497:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175508.349502:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145335808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175508.349502:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175508.349514:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175508.349516:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145336576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175508.349521:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175508.349529:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145335808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175508.349537:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145335936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175508.349556:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175508.349569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87d880 x1872931145335936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175508.349581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145335936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175508.349587:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175508.349591:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175508.349594:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145335936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175508.349599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145336064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175508.349609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175508.349615:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87f100 x1872931145336064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175508.349622:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145336064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175508.349631:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175508.349633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175508.349635:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145336064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175508.349646:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145336192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175508.349656:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175508.349661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87d500 x1872931145336192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175508.349668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145336192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175508.349674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175508.349675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175508.349677:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145336192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175508.349680:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145336320:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175508.349690:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175508.349696:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87df80 x1872931145336320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175508.349703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145336320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175508.349708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175508.349710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175508.349713:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145336320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175508.349716:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145336448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175508.349725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175508.349731:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87f800 x1872931145336448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175508.349737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145336448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175508.349742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175508.349744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175508.349746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145336448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175508.349750:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145336576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175508.349758:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175508.349763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175508/real 1786175508]  req@ffff89d99e87dc00 x1872931145336576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175508.349771:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145336576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175508.349776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175508.349777:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175508.349779:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145336576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175508.861021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175508.861054:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175509.372974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175509.885008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175509.885077:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175510.396983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175510.909010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175510.909140:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175511.420980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175511.933000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175511.933068:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175512.444984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175512.956996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175512.957043:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175513.468974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175513.468986:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175513.468992:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175513.468997:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175513.469005:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9247
00000100:00080000:2.0:1786175513.469014:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175513.469021:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175513.469054:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145336704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175513.469078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175513.469081:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175513.469082:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175513.469085:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9247
00000100:00080000:2.0:1786175513.469087:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175513.469090:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175513.469098:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175513.469108:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145336832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175513.469113:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145336704:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175513.469119:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175513.469123:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175513.469124:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175513.469128:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9247
00000100:00080000:2.0:1786175513.469130:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175513.469133:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175513.469144:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175513.469155:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145336960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175513.469162:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175513.469165:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175513.469167:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175513.469170:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9247
00000800:00000100:0.0:1786175513.469175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175513.469177:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175513.469183:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175513.469187:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175513.469200:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145337088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175513.469207:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175513.469210:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175513.469212:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175513.469217:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87c380 x1872931145336704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175513.469217:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9247
00000100:00080000:2.0:1786175513.469219:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175513.469226:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175513.469233:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175513.469246:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145336704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175513.469247:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145337216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175513.469277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175513.469281:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175513.469282:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175513.469283:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175513.469295:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175513.469295:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9247
00000100:00080000:2.0:1786175513.469300:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175513.469304:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175513.469307:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175513.469315:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145336704:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175513.469319:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145337344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175513.469335:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175513.469338:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175513.469340:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175513.469341:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145336832:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175513.469350:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9247
00000100:00080000:2.0:1786175513.469356:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175513.469361:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175513.469369:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175513.469372:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175513.469386:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87c700 x1872931145336832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175513.469390:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145337472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175513.469406:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145336832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175513.469413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175513.469417:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175513.469420:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175513.469423:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175513.469429:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9247
00000100:00080000:0.0:1786175513.469433:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175513.469438:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175513.469439:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145336832:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175513.469446:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175513.469450:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145336960:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175513.469454:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175513.469469:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145337600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175513.469475:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175513.469485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175513.469490:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175513.469491:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87c000 x1872931145336960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175513.469492:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175513.469502:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9247
00000100:00080000:2.0:1786175513.469509:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175513.469515:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175513.469522:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175513.469525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145336960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175513.469534:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175513.469535:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145337728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175513.469541:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175513.469548:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145336960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175513.469559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145337088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175513.469575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175513.469582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87dc00 x1872931145337088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175513.469590:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145337088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175513.469595:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175513.469597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175513.469599:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145337088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175513.469603:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145337216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175513.469613:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175513.469619:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87f800 x1872931145337216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175513.469627:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145337216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175513.469637:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175513.469639:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175513.469641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145337216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175513.469644:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145337344:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175513.469654:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175513.469660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87df80 x1872931145337344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175513.469667:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145337344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175513.469672:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175513.469674:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175513.469676:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145337344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175513.469688:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145337472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175513.469698:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175513.469708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87d500 x1872931145337472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175513.469720:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145337472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175513.469728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175513.469732:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175513.469736:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145337472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175513.469743:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145337600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175513.469764:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175513.469779:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87f100 x1872931145337600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175513.469788:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145337600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175513.469794:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175513.469796:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175513.469798:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145337600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175513.469802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145337728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175513.469815:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175513.469821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175513/real 1786175513]  req@ffff89d99e87d880 x1872931145337728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175513.469885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145337728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175513.469894:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175513.469919:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175513.469923:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145337728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175513.981022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175513.981071:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175514.493037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175515.005070:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175515.005098:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175515.517005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175516.028985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175516.029057:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175516.540990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175517.053008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175517.053039:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175517.564965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175518.077010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175518.077123:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175518.589016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175518.589177:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589182:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175518.589186:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175518.589194:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589202:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589210:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175518.589245:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145337856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175518.589270:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589273:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175518.589274:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175518.589277:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589280:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589282:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175518.589290:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175518.589299:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145337984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175518.589312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589314:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175518.589316:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175518.589319:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589321:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589324:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175518.589327:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175518.589335:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145338112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175518.589343:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589345:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175518.589347:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175518.589350:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589353:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589359:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175518.589361:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145337856:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175518.589364:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175518.589379:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145338240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175518.589387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589390:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175518.589391:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175518.589395:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589398:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589401:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175518.589404:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175518.589413:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145338368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175518.589420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589423:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175518.589424:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175518.589426:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589429:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589434:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175518.589437:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175518.589439:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175518.589461:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145338496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175518.589468:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589471:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175518.589472:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175518.589476:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589480:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589483:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175518.589487:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175518.589495:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe67b80 x1872931145337856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175518.589498:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145338624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175518.589539:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589542:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175518.589545:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175518.589547:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145337856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175518.589552:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589558:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589564:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175518.589570:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175518.589571:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.589579:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175518.589584:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145338752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175518.589586:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145337856:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175518.589603:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145337984:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175518.589603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175518.589614:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175518.589617:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175518.589620:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9252
00000100:00080000:3.0:1786175518.589623:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175518.589636:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175518.589641:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175518.589645:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175518.589659:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145338880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175518.589663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe65180 x1872931145337984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175518.589708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145337984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175518.589716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.589719:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175518.589723:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145337984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175518.589729:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145338112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175518.589742:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175518.589749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe67800 x1872931145338112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175518.589763:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145338112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175518.589800:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.589803:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175518.589806:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145338112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175518.589860:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145338240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175518.589882:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175518.589893:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe64380 x1872931145338240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175518.589957:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145338240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175518.589964:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.589966:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175518.589969:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145338240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175518.589974:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145338368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175518.589991:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175518.590000:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe66d80 x1872931145338368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175518.590008:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145338368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175518.590019:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.590022:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175518.590025:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145338368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175518.590029:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145338496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175518.590040:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175518.590046:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe66680 x1872931145338496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175518.590054:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145338496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175518.590061:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.590063:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175518.590065:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145338496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175518.590069:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145338624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175518.590080:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175518.590087:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe65f80 x1872931145338624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175518.590095:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145338624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175518.590101:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.590103:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175518.590106:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145338624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175518.590110:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145338752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175518.590121:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175518.590128:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe65500 x1872931145338752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175518.590136:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145338752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175518.590141:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.590143:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175518.590145:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145338752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175518.590149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145338880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175518.590160:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175518.590166:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175518/real 1786175518]  req@ffff89d99fe65880 x1872931145338880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175518.590175:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145338880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175518.590180:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175518.590182:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175518.590184:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145338880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175519.100999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175519.101140:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175519.613024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175520.124989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175520.125180:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175520.637012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175521.149004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175521.149028:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175521.660989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175522.173003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175522.173104:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175522.685063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175523.196974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175523.197077:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175523.708990:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175523.708996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175523.709002:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175523.709008:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175523.709017:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709027:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175523.709034:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175523.709072:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145339008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175523.709100:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175523.709104:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175523.709106:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175523.709109:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709112:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175523.709114:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175523.709123:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175523.709133:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145339136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175523.709142:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175523.709146:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175523.709148:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175523.709151:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709154:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175523.709160:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145339008:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175523.709161:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175523.709171:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175523.709180:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145339264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175523.709188:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175523.709191:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175523.709193:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175523.709196:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709199:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175523.709202:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175523.709206:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175523.709216:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145339392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175523.709224:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175523.709227:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175523.709229:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175523.709233:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709236:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175523.709238:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175523.709242:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175523.709251:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145339520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175523.709260:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175523.709263:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175523.709266:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175523.709273:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145339136:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175523.709273:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709279:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175523.709285:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175523.709290:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175523.709303:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145339648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175523.709311:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175523.709314:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175523.709316:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175523.709320:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709323:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175523.709326:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145339264:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175523.709332:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175523.709338:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175523.709352:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145339776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175523.709362:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175523.709364:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145339392:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175523.709369:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175523.709374:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175523.709378:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709382:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175523.709386:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175523.709391:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175523.709397:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145339520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175523.709407:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145339904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175523.709417:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175523.709422:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145339648:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175523.709423:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175523.709428:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175523.709436:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9257
00000100:00080000:3.0:1786175523.709440:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175523.709444:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175523.709450:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175523.709457:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145339776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175523.709464:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145340032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175523.709486:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145339904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175523.709505:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145340032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175524.220985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175524.221052:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175524.733148:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175525.245072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175525.245252:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175525.757099:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175526.269028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175526.269072:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175526.781306:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786175526.781373:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786175526.781438:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786175526.781457:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175526.781519:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786175526.781533:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175526.781547:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175526.781559:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175526.781575:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175526.781587:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786175526.781609:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175526.781613:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe65500 x1872931145340032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786175526.781621:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175526.781761:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145340032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.781788:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.781798:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.781807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145340032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175526.781825:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe64a80 x1872931145339776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175526.781856:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145339776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.781874:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.781882:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.781889:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145339776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175526.781942:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe65880 x1872931145339904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175526.781974:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145339904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.781992:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.781999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.782006:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145339904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175526.782020:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe66a00 x1872931145339264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175526.782052:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145339264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.782070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.782080:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.782088:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145339264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175526.782108:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe67100 x1872931145339392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175526.782135:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145339392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.782150:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.782158:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.782166:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145339392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175526.782183:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe67480 x1872931145339520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175526.782213:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145339520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.782230:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.782237:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.782245:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145339520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175526.782258:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe64000 x1872931145339648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175526.782283:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145339648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.782300:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.782307:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.782314:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145339648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175526.782327:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe64700 x1872931145339008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175526.782354:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145339008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.782370:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.782377:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.782383:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145339008:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175526.782397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175523/real 1786175526]  req@ffff89d99fe66300 x1872931145339136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175526.782421:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145339136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175526.782437:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175526.782444:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175526.782451:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145339136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175527.293029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175527.293126:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175527.805138:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175528.316998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786175528.317072:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175528.829055:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175528.829069:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175528.829074:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175528.829089:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00080000:2.0:1786175528.829103:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175528.829115:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175528.829134:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786175528.829162:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145340160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175528.829219:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175528.829224:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175528.829226:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175528.829230:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00080000:2.0:1786175528.829235:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175528.829240:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175528.829252:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175528.829269:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145340288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175528.829289:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175528.829295:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175528.829300:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175528.829304:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145340160:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175528.829311:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00080000:2.0:1786175528.829329:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175528.829336:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175528.829343:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175528.829362:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145340416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175528.829375:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175528.829379:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175528.829382:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175528.829387:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00080000:2.0:1786175528.829391:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175528.829396:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175528.829405:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175528.829415:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175528.829442:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145340544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175528.829462:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175528.829468:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175528.829475:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175528.829484:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00100000:0.0:1786175528.829493:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87ca80 x1872931145340160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175528.829495:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175528.829514:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175528.829531:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175528.829540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145340160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175528.829559:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175528.829564:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145340672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175528.829568:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175528.829582:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145340160:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175528.829624:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145340288:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175528.829626:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175528.829641:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175528.829644:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175528.829656:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00080000:2.0:1786175528.829667:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175528.829700:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175528.829711:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175528.829736:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145340800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175528.829756:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175528.829757:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175528.829771:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175528.829776:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175528.829787:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00080000:2.0:1786175528.829797:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175528.829801:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87e680 x1872931145340288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175528.829811:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175528.829831:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175528.829847:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145340288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175528.829867:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145340928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175528.829871:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175528.829888:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175528.829971:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145340288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175528.830000:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145340416:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175528.830008:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175528.830017:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175528.830021:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175528.830033:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00080000:2.0:1786175528.830042:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175528.830051:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175528.830063:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175528.830064:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175528.830102:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87ed80 x1872931145340416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175528.830116:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145341056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175528.830150:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175528.830154:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145340416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175528.830162:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175528.830171:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175528.830189:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9263
00000100:00080000:2.0:1786175528.830206:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175528.830215:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175528.830225:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175528.830234:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175528.830247:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175528.830257:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145341184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175528.830294:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145340416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175528.830315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145340544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175528.830369:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175528.830406:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87d880 x1872931145340544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175528.830441:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145340544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175528.830458:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175528.830465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175528.830471:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145340544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175528.830504:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145340672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175528.830544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175528.830568:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87f100 x1872931145340672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175528.830593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145340672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175528.830609:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175528.830616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175528.830623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145340672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175528.830636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145340800:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175528.830673:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175528.830720:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87d500 x1872931145340800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175528.830747:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145340800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175528.830763:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175528.830770:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175528.830778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145340800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175528.830795:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145340928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175528.830837:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175528.830862:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87df80 x1872931145340928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175528.830885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145340928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175528.830942:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175528.830949:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175528.830956:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145340928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175528.830969:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145341056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175528.831010:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175528.831035:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87f800 x1872931145341056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175528.831060:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145341056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175528.831078:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175528.831085:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175528.831092:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145341056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175528.831104:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145341184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175528.831141:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175528.831163:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175528/real 1786175528]  req@ffff89d99e87dc00 x1872931145341184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175528.831187:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145341184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175528.831215:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175528.831222:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175528.831235:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145341184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175529.341048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175529.341148:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175529.853060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175530.365020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175530.365086:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175530.876983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175531.389022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175531.389104:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175531.900958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175532.413020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175532.413108:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175532.925033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175533.437091:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175533.437202:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175533.949051:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175533.949078:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175533.949085:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175533.949101:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00080000:2.0:1786175533.949116:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175533.949128:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175533.949152:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786175533.949181:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145341312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175533.949218:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175533.949223:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175533.949226:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175533.949231:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00080000:2.0:1786175533.949235:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175533.949239:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175533.949252:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175533.949269:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145341440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175533.949285:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175533.949290:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175533.949292:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175533.949301:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00100000:0.0:1786175533.949306:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145341312:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175533.949307:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175533.949319:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175533.949330:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175533.949345:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145341568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175533.949360:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175533.949364:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175533.949367:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175533.949372:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00080000:2.0:1786175533.949377:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175533.949381:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175533.949388:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175533.949401:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145341696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175533.949412:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175533.949417:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175533.949425:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175533.949426:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175533.949437:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00080000:2.0:1786175533.949444:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175533.949450:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175533.949457:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175533.949472:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145341824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175533.949484:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175533.949488:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175533.949491:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175533.949497:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00080000:2.0:1786175533.949507:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175533.949508:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87c000 x1872931145341312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175533.949516:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175533.949530:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175533.949554:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145341952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175533.949569:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175533.949570:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145341312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175533.949581:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175533.949588:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175533.949603:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00080000:0.0:1786175533.949606:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175533.949609:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175533.949617:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175533.949622:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175533.949654:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145341312:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786175533.949660:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175533.949672:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145341440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175533.949685:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145342080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175533.949701:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175533.949705:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175533.949708:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175533.949714:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00080000:2.0:1786175533.949721:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175533.949729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175533.949734:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175533.949743:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175533.949761:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145342208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175533.949773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87c700 x1872931145341440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175533.949833:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175533.949839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145341440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175533.949846:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175533.949857:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175533.949863:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175533.949875:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9268
00000100:00080000:0.0:1786175533.949876:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175533.949886:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145341440:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175533.949892:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175533.949955:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175533.949964:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175533.949970:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145341568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175533.949993:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145342336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175533.950033:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175533.950063:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87c380 x1872931145341568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175533.950092:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145341568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175533.950130:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175533.950139:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175533.950147:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145341568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175533.950162:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145341696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175533.950204:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175533.950222:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87dc00 x1872931145341696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175533.950239:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145341696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175533.950249:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175533.950253:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175533.950258:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145341696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175533.950265:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145341824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175533.950286:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175533.950298:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87f800 x1872931145341824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175533.950313:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145341824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175533.950330:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175533.950336:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175533.950343:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145341824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175533.950354:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145341952:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175533.950392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175533.950416:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87df80 x1872931145341952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175533.950439:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145341952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175533.950453:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175533.950459:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175533.950465:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145341952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175533.950477:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145342080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175533.950517:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175533.950541:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87d500 x1872931145342080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175533.950564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145342080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175533.950575:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175533.950579:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175533.950583:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145342080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175533.950591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145342208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175533.950618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175533.950659:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87f100 x1872931145342208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175533.950676:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145342208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175533.950695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175533.950699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175533.950704:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145342208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175533.950747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145342336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175533.950788:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175533.950812:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175533/real 1786175533]  req@ffff89d99e87d880 x1872931145342336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175533.950831:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145342336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175533.950842:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175533.950846:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175533.950850:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145342336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175534.460987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175534.461067:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175534.973029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175535.485053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175535.485111:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175535.997053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175536.509040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175536.509164:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175537.020988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175537.533006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175537.533118:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175538.045069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175538.557048:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175538.557073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786175539.068965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175539.068982:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175539.068988:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175539.068992:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175539.069001:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00080000:2.0:1786175539.069009:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175539.069015:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175539.069050:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145342464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175539.069083:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175539.069086:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175539.069087:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175539.069090:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00080000:2.0:1786175539.069092:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175539.069094:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175539.069102:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175539.069111:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145342592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175539.069120:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175539.069122:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175539.069124:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175539.069127:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00080000:2.0:1786175539.069129:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175539.069136:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145342464:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175539.069136:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175539.069145:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175539.069161:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145342720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175539.069173:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175539.069178:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175539.069180:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175539.069183:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00080000:2.0:1786175539.069188:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175539.069193:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175539.069198:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175539.069202:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175539.069219:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145342848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175539.069231:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175539.069236:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87ed80 x1872931145342464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175539.069238:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175539.069242:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175539.069252:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00080000:2.0:1786175539.069257:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175539.069261:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145342464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175539.069262:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175539.069269:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175539.069283:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175539.069285:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145342976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175539.069294:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175539.069296:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175539.069300:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786175539.069303:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145342464:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175539.069303:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175539.069311:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00080000:2.0:1786175539.069316:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175539.069318:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175539.069322:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145342592:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175539.069325:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175539.069336:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145343104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175539.069343:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175539.069346:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175539.069348:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175539.069352:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175539.069356:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00080000:2.0:1786175539.069361:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175539.069363:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175539.069367:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175539.069370:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87e680 x1872931145342592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175539.069378:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145343232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175539.069385:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145342592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175539.069417:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175539.069425:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175539.069427:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175539.069428:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175539.069437:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175539.069439:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00100000:0.0:1786175539.069444:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145342592:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175539.069445:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175539.069452:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175539.069457:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175539.069467:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145343360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175539.069477:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145342720:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175539.069477:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175539.069486:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175539.069489:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175539.069494:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9273
00000100:00080000:2.0:1786175539.069498:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175539.069502:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175539.069506:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175539.069507:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175539.069521:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145343488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175539.069525:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87ca80 x1872931145342720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175539.069561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145342720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175539.069570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175539.069573:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175539.069593:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145342720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175539.069616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145342848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175539.069632:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175539.069640:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87d880 x1872931145342848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175539.069648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145342848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175539.069653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175539.069655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175539.069657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145342848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175539.069661:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145342976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175539.069671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175539.069676:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87f100 x1872931145342976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175539.069683:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145342976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175539.069688:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175539.069690:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175539.069692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145342976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175539.069695:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145343104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175539.069704:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175539.069710:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87d500 x1872931145343104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175539.069717:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145343104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175539.069726:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175539.069728:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175539.069730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145343104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175539.069733:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145343232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175539.069742:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175539.069748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87df80 x1872931145343232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175539.069755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145343232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175539.069760:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175539.069762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175539.069764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145343232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175539.069775:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145343360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175539.069785:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175539.069791:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87f800 x1872931145343360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175539.069798:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145343360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175539.069803:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175539.069804:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175539.069807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145343360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175539.069811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145343488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175539.069820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175539.069826:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175539/real 1786175539]  req@ffff89d99e87dc00 x1872931145343488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175539.069833:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145343488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175539.069838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175539.069839:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175539.069841:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145343488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175539.581029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175539.581103:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175540.093019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175540.604973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175540.605059:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175541.117004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175541.629025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175541.629218:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175542.141055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175542.653058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175542.653142:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175543.165030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175543.676990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175543.677168:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175544.189046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175544.189166:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175544.189179:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175544.189187:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175544.189206:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9278
00000100:00080000:0.0:1786175544.189222:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175544.189236:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175544.189291:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145343616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175544.189323:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175544.189328:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175544.189331:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175544.189337:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9278
00000100:00080000:0.0:1786175544.189347:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175544.189354:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175544.189368:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145343616:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786175544.189369:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175544.189407:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145343744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175544.189434:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175544.189440:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175544.189444:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175544.189459:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9278
00000100:00080000:0.0:1786175544.189482:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175544.189489:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175544.189499:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175544.189518:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175544.189582:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145343872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175544.189599:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175544.189604:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175544.189607:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175544.189618:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9278
00000100:00100000:1.0:1786175544.189619:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f3b80 x1872931145343616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175544.189633:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175544.189657:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175544.189672:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175544.189681:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145343616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175544.189699:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145344000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175544.189703:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175544.189725:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175544.189737:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145343616:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175544.189772:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175544.189777:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175544.189780:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175544.189787:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9278
00000100:00080000:0.0:1786175544.189792:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175544.189797:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175544.189803:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175544.189820:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145343744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175544.189825:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145344128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175544.189856:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175544.189861:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175544.189865:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175544.189873:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9278
00000800:00000100:1.0:1786175544.189876:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175544.189890:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175544.189911:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f0a80 x1872931145343744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175544.189969:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175544.189979:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145343744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175544.189983:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175544.190019:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175544.190029:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145344256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175544.190034:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175544.190050:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145343744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175544.190080:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145343872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175544.190087:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175544.190098:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175544.190104:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175544.190119:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9278
00000800:00000100:1.0:1786175544.190119:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175544.190147:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175544.190160:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175544.190173:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f1180 x1872931145343872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175544.190174:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175544.190209:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145343872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175544.190217:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145344384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175544.190266:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175544.190276:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175544.190283:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175544.190291:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175544.190297:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175544.190299:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145343872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175544.190317:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9278
00000100:00080000:0.0:1786175544.190323:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175544.190326:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145344000:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175544.190336:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175544.190345:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175544.190370:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145344512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175544.190373:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175544.190398:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f1880 x1872931145344000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175544.190400:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175544.190429:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175544.190439:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175544.190466:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9278
00000100:00100000:1.0:1786175544.190468:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145344000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175544.190479:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175544.190505:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175544.190552:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175544.190598:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145344640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175544.190603:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175544.190631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175544.190648:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145344000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175544.190733:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145344128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175544.190780:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175544.190792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f0e00 x1872931145344128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175544.190803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145344128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175544.190812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175544.190815:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175544.190818:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145344128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175544.190824:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145344256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175544.190838:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175544.190847:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f3100 x1872931145344256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175544.190857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145344256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175544.190865:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175544.190867:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175544.190871:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145344256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175544.190876:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145344384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175544.190891:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175544.190899:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f3480 x1872931145344384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175544.190909:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145344384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175544.190916:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175544.190919:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175544.190922:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145344384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175544.190928:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145344512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175544.190988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175544.191000:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f2a00 x1872931145344512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175544.191010:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145344512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175544.191019:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175544.191022:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175544.191025:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145344512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175544.191032:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145344640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175544.191049:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175544.191058:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175544/real 1786175544]  req@ffff89d9870f2d80 x1872931145344640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175544.191070:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145344640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175544.191078:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175544.191080:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175544.191083:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145344640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175544.701044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175544.701229:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175545.212994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175545.724975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175545.725087:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175546.237062:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175546.749081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175546.749156:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175547.261017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175547.772985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175547.773068:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175548.285069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175548.797065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175548.797213:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175549.309073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175549.309077:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309085:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175549.309090:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175549.309099:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00080000:2.0:1786175549.309108:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175549.309116:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175549.309153:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145344768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175549.309196:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309199:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175549.309200:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175549.309203:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00080000:2.0:1786175549.309206:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175549.309208:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175549.309216:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175549.309228:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145344896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175549.309236:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145344768:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175549.309239:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309245:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175549.309247:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175549.309251:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00080000:2.0:1786175549.309253:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175549.309256:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175549.309259:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175549.309267:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145345024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175549.309279:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309281:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175549.309283:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175549.309285:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00080000:2.0:1786175549.309288:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175549.309290:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175549.309294:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175549.309299:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175549.309307:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145345152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175549.309314:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309317:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175549.309318:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175549.309321:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00080000:2.0:1786175549.309324:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175549.309326:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175549.309330:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175549.309339:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87c380 x1872931145344768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175549.309340:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145345280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175549.309375:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309378:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175549.309380:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175549.309384:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145344768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175549.309386:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00080000:2.0:1786175549.309391:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175549.309398:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175549.309404:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175549.309405:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175549.309413:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145345408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175549.309419:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175549.309420:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309427:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786175549.309431:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145344768:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175549.309432:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175549.309440:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00080000:2.0:1786175549.309443:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175549.309446:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175549.309449:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175549.309455:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145345536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175549.309462:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145344896:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175549.309464:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309471:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175549.309472:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175549.309495:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00080000:2.0:1786175549.309499:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175549.309502:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175549.309507:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175549.309521:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175549.309524:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145345664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175549.309538:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87c700 x1872931145344896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175549.309540:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175549.309548:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175549.309552:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175549.309559:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9283
00000100:00100000:1.0:1786175549.309565:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145344896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175549.309570:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175549.309573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175549.309577:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175549.309582:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786175549.309584:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175549.309586:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145344896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175549.309595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145345024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175549.309598:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145345792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175549.309617:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175549.309629:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87c000 x1872931145345024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175549.309638:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145345024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175549.309644:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175549.309646:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175549.309648:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145345024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175549.309652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145345152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175549.309663:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175549.309670:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87dc00 x1872931145345152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175549.309678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145345152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175549.309684:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175549.309686:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175549.309688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145345152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175549.309691:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145345280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175549.309702:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175549.309708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87f800 x1872931145345280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175549.309716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145345280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175549.309721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175549.309723:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175549.309725:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145345280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175549.309728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145345408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175549.309739:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175549.309744:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87df80 x1872931145345408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175549.309752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145345408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175549.309758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175549.309760:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175549.309762:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145345408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175549.309777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145345536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175549.309788:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175549.309795:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87d500 x1872931145345536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175549.309802:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145345536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175549.309808:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175549.309810:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175549.309811:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145345536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175549.309815:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145345664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175549.309825:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175549.309831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87f100 x1872931145345664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175549.309839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145345664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175549.309844:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175549.309846:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175549.309849:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145345664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175549.309852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145345792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175549.309862:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175549.309867:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175549/real 1786175549]  req@ffff89d99e87d880 x1872931145345792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175549.309874:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145345792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175549.309880:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175549.309882:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175549.309886:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145345792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175549.821041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175549.821175:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175550.333002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175550.845076:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175550.845189:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175551.357081:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175551.869062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175551.869066:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175552.381022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175552.893035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175552.893164:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175553.404984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175553.916972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175553.917067:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175554.429006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175554.429024:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175554.429035:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175554.429041:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175554.429054:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9288
00000100:00080000:2.0:1786175554.429066:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175554.429076:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175554.429120:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145345920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175554.429158:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175554.429164:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175554.429167:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175554.429173:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9288
00000100:00080000:2.0:1786175554.429180:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175554.429187:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175554.429201:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175554.429203:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145345920:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175554.429229:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145346048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175554.429249:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175554.429255:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175554.429258:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175554.429264:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9288
00000100:00080000:2.0:1786175554.429270:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786175554.429278:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175554.429280:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175554.429292:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175554.429313:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145346176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175554.429329:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175554.429336:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87ca80 x1872931145345920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175554.429337:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175554.429343:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175554.429357:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9288
00000100:00080000:2.0:1786175554.429366:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175554.429372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145345920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175554.429374:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175554.429392:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175554.429394:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175554.429405:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175554.429410:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145345920:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175554.429423:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145346304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175554.429461:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145346048:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175554.429462:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175554.429471:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175554.429485:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175554.429491:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9288
00000100:00080000:2.0:1786175554.429496:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175554.429501:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175554.429507:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175554.429515:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175554.429541:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145346432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175554.429543:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87e680 x1872931145346048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175554.429595:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175554.429598:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145346048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175554.429610:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175554.429617:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175554.429618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175554.429628:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175554.429633:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9288
00000100:00100000:1.0:1786175554.429635:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145346048:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175554.429645:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175554.429647:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145346176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175554.429661:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175554.429670:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175554.429680:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175554.429697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87ed80 x1872931145346176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175554.429697:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145346560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175554.429736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145346176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175554.429743:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175554.429751:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175554.429753:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175554.429758:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175554.429762:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175554.429764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145346176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175554.429779:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9288
00000100:00080000:2.0:1786175554.429787:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175554.429791:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145346304:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175554.429799:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175554.429809:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175554.429818:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175554.429840:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145346688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175554.429841:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87d880 x1872931145346304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175554.429892:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175554.429929:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175554.429932:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175554.429940:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9288
00000100:00100000:1.0:1786175554.429946:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145346304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175554.429949:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175554.429963:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175554.429972:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175554.429975:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175554.429983:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175554.429990:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145346304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175554.430002:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145346816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175554.430005:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145346432:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175554.430030:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175554.430036:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175554.430039:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175554.430047:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9288
00000800:00000100:1.0:1786175554.430054:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175554.430058:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175554.430069:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175554.430077:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175554.430080:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87f100 x1872931145346432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175554.430100:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145346944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175554.430106:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145346432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175554.430142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175554.430147:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175554.430153:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145346432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175554.430160:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145346560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175554.430183:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175554.430193:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87d500 x1872931145346560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175554.430210:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145346560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175554.430217:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175554.430219:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175554.430222:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145346560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175554.430236:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145346688:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175554.430251:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175554.430260:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87df80 x1872931145346688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175554.430270:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145346688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175554.430278:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175554.430282:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175554.430286:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145346688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175554.430295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145346816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175554.430321:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175554.430337:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87f800 x1872931145346816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175554.430354:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145346816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175554.430368:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175554.430371:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175554.430374:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145346816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175554.430379:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145346944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175554.430398:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175554.430407:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175554/real 1786175554]  req@ffff89d99e87dc00 x1872931145346944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175554.430417:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145346944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175554.430425:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175554.430444:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175554.430448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145346944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175554.941015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175554.941120:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175555.453035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175555.965022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175555.965184:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175556.476974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175556.989017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175556.989093:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175557.500979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175558.013036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175558.013079:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175558.525022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175559.037038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175559.037303:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175559.549024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175559.549037:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1786175559.549038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175559.549043:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175559.549060:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:2.0:1786175559.549073:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175559.549081:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175559.549128:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145347072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175559.549156:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175559.549159:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175559.549161:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175559.549164:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:2.0:1786175559.549167:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175559.549171:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175559.549181:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175559.549195:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145347200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175559.549197:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145347072:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175559.549212:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175559.549215:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175559.549216:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175559.549219:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:2.0:1786175559.549221:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175559.549224:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175559.549228:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175559.549239:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145347328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175559.549251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175559.549254:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175559.549256:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175559.549258:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:2.0:1786175559.549261:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175559.549263:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175559.549267:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175559.549276:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145347456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175559.549284:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175559.549284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175559.549289:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175559.549291:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175559.549295:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:2.0:1786175559.549299:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175559.549302:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175559.549306:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175559.549317:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145347584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175559.549324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175559.549326:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175559.549328:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175559.549332:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:2.0:1786175559.549336:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175559.549341:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87c000 x1872931145347072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175559.549342:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175559.549349:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175559.549363:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145347712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175559.549369:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145347072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175559.549373:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175559.549396:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175559.549399:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175559.549405:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:1.0:1786175559.549407:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175559.549408:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175559.549414:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175559.549417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786175559.549421:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175559.549424:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145347072:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175559.549434:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145347840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175559.549444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175559.549446:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175559.549448:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175559.549456:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145347200:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175559.549459:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:2.0:1786175559.549464:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175559.549468:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175559.549472:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175559.549482:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145347968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175559.549488:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175559.549503:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175559.549506:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87c700 x1872931145347200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175559.549507:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175559.549511:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175559.549518:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9293
00000100:00080000:2.0:1786175559.549525:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175559.549529:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145347200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175559.549530:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175559.549537:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175559.549546:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175559.549552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175559.549554:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145348096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175559.549558:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145347200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175559.549572:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145347328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175559.549592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175559.549600:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87c380 x1872931145347328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175559.549609:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145347328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175559.549617:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175559.549621:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175559.549625:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145347328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175559.549632:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145347456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175559.549655:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175559.549669:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87dc00 x1872931145347456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175559.549684:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145347456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175559.549691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175559.549694:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175559.549696:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145347456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175559.549701:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145347584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175559.549718:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175559.549726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87f800 x1872931145347584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175559.549735:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145347584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175559.549741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175559.549744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175559.549746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145347584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175559.549750:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145347712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175559.549761:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175559.549768:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87df80 x1872931145347712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175559.549777:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145347712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175559.549783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175559.549785:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175559.549787:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145347712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175559.549790:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145347840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175559.549802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175559.549808:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87d500 x1872931145347840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175559.549817:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145347840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175559.549823:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175559.549824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175559.549826:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145347840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175559.549860:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145347968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175559.549872:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175559.549879:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87f100 x1872931145347968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175559.549886:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145347968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175559.549921:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175559.549923:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175559.549925:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145347968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175559.549929:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145348096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175559.549944:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175559.549952:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175559/real 1786175559]  req@ffff89d99e87d880 x1872931145348096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175559.549966:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145348096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175559.549976:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175559.549980:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175559.549984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145348096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175560.061053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175560.061114:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175560.573069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175561.085016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175561.085122:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175561.596996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175562.108979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175562.109144:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175562.620987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175563.132999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175563.133068:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175563.645049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175564.156977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175564.157112:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175564.669001:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175564.669017:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175564.669024:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175564.669027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175564.669043:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9298
00000100:00080000:2.0:1786175564.669064:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175564.669076:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175564.669136:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145348224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175564.669176:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175564.669182:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175564.669185:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175564.669191:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9298
00000100:00080000:2.0:1786175564.669200:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175564.669209:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175564.669227:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175564.669240:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145348224:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175564.669252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145348352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175564.669267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175564.669273:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175564.669276:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175564.669285:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9298
00000100:00080000:2.0:1786175564.669291:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175564.669299:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175564.669310:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175564.669351:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145348480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175564.669378:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175564.669390:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175564.669399:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175564.669406:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175564.669417:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9298
00000100:00080000:2.0:1786175564.669428:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175564.669437:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175564.669449:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175564.669451:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87ed80 x1872931145348224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175564.669492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145348224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175564.669500:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145348608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175564.669529:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175564.669548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175564.669555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175564.669558:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175564.669566:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175564.669570:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145348224:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175564.669583:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9298
00000100:00080000:2.0:1786175564.669593:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175564.669604:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175564.669613:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175564.669618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145348352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175564.669672:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175564.669677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145348736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175564.669695:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87e680 x1872931145348352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175564.669704:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175564.669716:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786175564.669721:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145348352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175564.669724:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175564.669755:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175564.669755:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9298
00000100:00080000:2.0:1786175564.669770:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175564.669781:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175564.669789:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175564.669796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145348352:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175564.669804:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175564.669810:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145348480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175564.669840:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145348864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175564.669854:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175564.669877:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175564.669878:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87ca80 x1872931145348480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175564.669954:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145348480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175564.669956:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175564.669964:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175564.669982:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9298
00000100:00080000:1.0:1786175564.669992:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175564.669994:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175564.670012:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175564.670013:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786175564.670031:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175564.670033:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145348480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175564.670059:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145348608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175564.670068:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145348992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175564.670089:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175564.670094:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175564.670098:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175564.670108:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9298
00000800:00000100:1.0:1786175564.670116:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175564.670126:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175564.670143:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175564.670145:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87d880 x1872931145348608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175564.670163:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175564.670171:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145348608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175564.670184:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175564.670195:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175564.670200:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145349120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175564.670203:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145348608:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175564.670241:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175564.670248:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786175564.670250:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145348736:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175564.670254:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175564.670286:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9298
00000800:00000100:1.0:1786175564.670298:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175564.670305:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175564.670317:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87f100 x1872931145348736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175564.670320:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175564.670357:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175564.670393:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145348736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175564.670407:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175564.670410:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145349248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175564.670416:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175564.670429:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145348736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175564.670456:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145348864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175564.670497:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175564.670519:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87d500 x1872931145348864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175564.670535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145348864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175564.670545:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175564.670549:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175564.670552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145348864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175564.670560:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145348992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175564.670580:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175564.670602:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87df80 x1872931145348992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175564.670617:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145348992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175564.670626:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175564.670629:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175564.670633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145348992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175564.670640:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145349120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175564.670658:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175564.670673:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87f800 x1872931145349120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175564.670686:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145349120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175564.670704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175564.670708:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175564.670712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145349120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175564.670732:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145349248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175564.670751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175564.670763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175564/real 1786175564]  req@ffff89d99e87dc00 x1872931145349248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175564.670777:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145349248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175564.670787:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175564.670790:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175564.670794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145349248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175565.181040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175565.181182:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175565.693042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175566.205003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175566.205110:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175566.717031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175567.229030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175567.229161:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175567.741064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175568.253015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175568.253289:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175568.765036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175569.276956:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175569.277179:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175569.788975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175569.789045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175569.789053:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175569.789058:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175569.789069:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789081:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175569.789089:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175569.789135:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145349376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175569.789164:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175569.789167:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175569.789169:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175569.789172:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789174:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175569.789178:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175569.789188:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175569.789204:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145349504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175569.789212:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145349376:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175569.789219:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175569.789223:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175569.789224:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175569.789228:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789232:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175569.789235:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175569.789239:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175569.789251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145349632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175569.789263:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175569.789266:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175569.789269:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175569.789271:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789275:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175569.789295:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175569.789304:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175569.789308:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175569.789324:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145349760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175569.789333:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175569.789336:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175569.789339:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175569.789342:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789347:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175569.789353:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175569.789360:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87c380 x1872931145349376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175569.789362:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175569.789386:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145349888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175569.789391:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145349376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175569.789435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175569.789438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175569.789446:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175569.789448:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175569.789454:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175569.789455:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145349376:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175569.789472:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789480:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175569.789486:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175569.789492:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145349504:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175569.789494:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175569.789520:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145350016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175569.789531:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175569.789539:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175569.789544:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175569.789546:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175569.789550:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87c700 x1872931145349504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175569.789555:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789563:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175569.789572:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175569.789577:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145349504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175569.789580:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175569.789602:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145350144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175569.789613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175569.789620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175569.789626:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175569.789627:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175569.789632:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175569.789636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145349504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175569.789643:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789648:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175569.789650:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145349632:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175569.789656:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175569.789662:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175569.789674:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145350272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175569.789685:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175569.789703:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87c000 x1872931145349632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175569.789705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175569.789724:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175569.789730:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175569.789740:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9304
00000100:00080000:2.0:1786175569.789743:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175569.789744:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145349632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175569.789756:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175569.789772:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175569.789772:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175569.789788:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175569.789795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145349632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175569.789797:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145350400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175569.789819:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145349760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175569.789840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175569.789859:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87dc00 x1872931145349760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175569.789867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145349760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175569.789873:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175569.789875:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175569.789877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145349760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175569.789881:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145349888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175569.789894:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175569.789921:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87f800 x1872931145349888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175569.789929:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145349888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175569.789934:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175569.789937:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175569.789939:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145349888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175569.789954:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145350016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175569.789967:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175569.789974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87df80 x1872931145350016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175569.789982:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145350016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175569.789988:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175569.789990:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175569.789992:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145350016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175569.789996:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145350144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175569.790006:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175569.790012:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87d500 x1872931145350144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175569.790020:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145350144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175569.790025:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175569.790028:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175569.790031:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145350144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175569.790038:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145350272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175569.790059:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175569.790071:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87f100 x1872931145350272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175569.790084:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145350272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175569.790096:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175569.790098:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175569.790100:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145350272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175569.790105:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145350400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175569.790121:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175569.790128:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175569/real 1786175569]  req@ffff89d99e87d880 x1872931145350400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175569.790135:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145350400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175569.790141:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175569.790143:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175569.790145:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145350400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175570.301050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175570.301212:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175570.813028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175571.325065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175571.325234:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175571.837060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175572.349055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175572.349134:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175572.861090:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175573.372979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175573.373067:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175573.885003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175574.397069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175574.397195:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175574.909116:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175574.909133:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175574.909141:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175574.909169:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00080000:3.0:1786175574.909210:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175574.909211:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175574.909225:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175574.909334:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145350528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175574.909379:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175574.909386:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175574.909389:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175574.909397:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00080000:3.0:1786175574.909406:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175574.909414:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175574.909429:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175574.909455:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145350656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175574.909478:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145350528:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175574.909490:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175574.909499:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175574.909503:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175574.909512:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00080000:3.0:1786175574.909519:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175574.909527:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175574.909537:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175574.909577:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145350784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175574.909599:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786175574.909601:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175574.909614:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175574.909620:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175574.909630:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00080000:3.0:1786175574.909640:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175574.909671:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175574.909683:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175574.909691:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe65f80 x1872931145350528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175574.909717:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145350912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175574.909735:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145350528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175574.909801:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175574.909804:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175574.909816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175574.909820:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175574.909830:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175574.909833:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145350528:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175574.909845:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00080000:3.0:1786175574.909868:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175574.909877:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175574.909889:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175574.909899:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145350656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175574.909971:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145351040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175574.909997:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175574.910004:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175574.910014:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786175574.910016:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175574.910033:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00080000:3.0:1786175574.910052:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175574.910064:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe66680 x1872931145350656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175574.910069:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175574.910088:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175574.910110:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145350656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175574.910130:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145351168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175574.910136:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175574.910154:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175574.910170:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175574.910171:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145350656:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175574.910216:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175574.910223:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175574.910225:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145350784:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175574.910271:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00080000:3.0:1786175574.910284:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175574.910292:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175574.910302:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175574.910317:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175574.910330:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145351296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175574.910348:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe66d80 x1872931145350784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175574.910354:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175574.910373:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175574.910380:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175574.910393:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00100000:1.0:1786175574.910401:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145350784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175574.910404:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175574.910423:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175574.910439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175574.910441:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175574.910454:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175574.910464:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145350784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175574.910473:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145351424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175574.910499:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145350912:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175574.910501:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175574.910513:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175574.910519:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175574.910526:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9309
00000100:00080000:3.0:1786175574.910531:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175574.910537:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175574.910545:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175574.910560:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175574.910566:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145351552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175574.910594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe64380 x1872931145350912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175574.910622:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145350912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175574.910638:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175574.910644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175574.910650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145350912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175574.910682:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145351040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175574.910715:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175574.910736:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe67800 x1872931145351040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175574.910758:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145351040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175574.910773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175574.910779:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175574.910786:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145351040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175574.910796:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145351168:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175574.910827:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175574.910851:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe65180 x1872931145351168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175574.910873:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145351168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175574.910887:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175574.910893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175574.910932:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145351168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175574.910944:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145351296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175574.910981:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175574.911002:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe67b80 x1872931145351296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175574.911024:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145351296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175574.911040:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175574.911045:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175574.911051:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145351296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175574.911063:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145351424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175574.911092:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175574.911119:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe65f80 x1872931145351424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175574.911139:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145351424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175574.911175:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175574.911181:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175574.911187:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145351424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175574.911196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145351552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175574.911227:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175574.911277:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175574/real 1786175574]  req@ffff89d99fe66300 x1872931145351552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175574.911308:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145351552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175574.911321:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175574.911327:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175574.911333:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145351552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175575.420987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175575.421269:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175575.933031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175576.444983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175576.445108:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175576.957012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175577.469004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175577.469102:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175577.980986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175578.492998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175578.493109:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175579.005005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175579.517024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175579.517126:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175580.028998:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029007:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175580.029012:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175580.029025:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9314
00000100:00080000:3.0:1786175580.029039:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175580.029046:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175580.029081:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145351680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175580.029085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175580.029111:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029115:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175580.029117:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175580.029121:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9314
00000100:00080000:3.0:1786175580.029124:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175580.029127:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175580.029135:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175580.029146:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145351808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175580.029154:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029157:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175580.029160:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175580.029163:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9314
00000100:00080000:3.0:1786175580.029165:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175580.029167:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175580.029171:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175580.029196:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145351936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175580.029205:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029208:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175580.029210:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175580.029213:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9314
00000100:00080000:3.0:1786175580.029217:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175580.029220:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175580.029226:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175580.029236:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145351680:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175580.029241:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145352064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175580.029251:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029253:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175580.029255:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175580.029258:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9314
00000100:00080000:3.0:1786175580.029261:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175580.029264:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175580.029268:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175580.029280:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145352192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175580.029287:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029290:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175580.029292:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175580.029296:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9314
00000100:00080000:3.0:1786175580.029302:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175580.029308:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175580.029346:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe64700 x1872931145351680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175580.029366:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145351680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175580.029370:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175580.029379:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175580.029385:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175580.029393:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145352320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175580.029395:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175580.029406:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145351680:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175580.029408:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029416:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175580.029418:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175580.029424:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145351808:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175580.029425:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9314
00000100:00080000:3.0:1786175580.029432:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175580.029436:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175580.029440:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175580.029459:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175580.029470:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe64000 x1872931145351808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175580.029481:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145351808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175580.029493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175580.029512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175580.029515:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145351808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175580.029522:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145351936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175580.029546:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175580.029558:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe67480 x1872931145351936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175580.029571:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145351936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175580.029580:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175580.029583:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175580.029587:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145351936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175580.029630:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145352064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175580.029632:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145352448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175580.029648:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175580.029649:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029655:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175580.029659:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175580.029660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe67100 x1872931145352064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175580.029675:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145352064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175580.029682:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175580.029685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175580.029688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145352064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175580.029694:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145352192:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175580.029709:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9314
00000800:00000100:0.0:1786175580.029712:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175580.029718:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175580.029725:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175580.029728:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe66a00 x1872931145352192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175580.029733:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175580.029751:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145352576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175580.029759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145352192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175580.029763:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175580.029773:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175580.029775:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175580.029776:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175580.029784:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175580.029786:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9314
00000100:00080000:3.0:1786175580.029791:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175580.029792:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145352192:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175580.029797:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175580.029804:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145352320:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175580.029804:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175580.029821:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145352704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175580.029830:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175580.029843:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe65880 x1872931145352320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175580.029853:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145352320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175580.029860:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175580.029862:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175580.029864:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145352320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175580.029874:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145352448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175580.029886:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175580.029893:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe64a80 x1872931145352448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175580.029932:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145352448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175580.029939:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175580.029941:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175580.029945:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145352448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175580.029952:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145352576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175580.029971:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175580.029981:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe65500 x1872931145352576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175580.030008:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145352576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175580.030016:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175580.030019:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175580.030022:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145352576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175580.030027:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145352704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175580.030043:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175580.030052:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175580/real 1786175580]  req@ffff89d99fe67480 x1872931145352704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175580.030062:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145352704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175580.030070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175580.030074:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175580.030077:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145352704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175580.540990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175580.541083:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175581.053034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175581.564955:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175581.565045:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175582.077011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175582.589023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175582.589221:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175583.101027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175583.613033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175583.613240:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175584.124981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175584.637018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175584.637100:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175585.149011:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175585.149012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175585.149025:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175585.149030:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175585.149040:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00080000:3.0:1786175585.149050:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175585.149058:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175585.149104:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145352832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175585.149129:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175585.149150:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175585.149153:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175585.149160:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00080000:3.0:1786175585.149165:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175585.149170:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175585.149181:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175585.149190:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145352832:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175585.149199:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145352960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175585.149212:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175585.149215:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175585.149217:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175585.149221:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00080000:3.0:1786175585.149225:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175585.149228:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175585.149232:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175585.149244:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145353088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175585.149253:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175585.149256:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175585.149258:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175585.149262:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00080000:3.0:1786175585.149284:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175585.149288:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175585.149293:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175585.149300:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175585.149311:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145353216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175585.149321:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175585.149325:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175585.149327:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175585.149332:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00080000:3.0:1786175585.149336:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175585.149339:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175585.149343:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175585.149354:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145353344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175585.149363:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175585.149369:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786175585.149371:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe64000 x1872931145352832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175585.149372:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175585.149382:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00080000:3.0:1786175585.149405:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175585.149413:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175585.149419:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175585.149430:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145352832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175585.149434:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145353472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175585.149464:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175585.149464:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175585.149474:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175585.149477:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175585.149479:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175585.149484:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00080000:3.0:1786175585.149491:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175585.149497:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145352832:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175585.149498:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175585.149506:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175585.149518:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145353600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175585.149527:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175585.149531:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175585.149534:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175585.149543:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00100000:0.0:1786175585.149544:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145352960:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175585.149553:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175585.149575:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175585.149583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175585.149588:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175585.149602:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe64700 x1872931145352960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175585.149611:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145353728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175585.149624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145352960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175585.149629:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175585.149640:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175585.149645:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175585.149649:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175585.149653:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9319
00000100:00080000:0.0:1786175585.149659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175585.149662:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175585.149667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145352960:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175585.149671:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175585.149679:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175585.149680:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145353088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175585.149697:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145353856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175585.149717:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175585.149745:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe66300 x1872931145353088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175585.149766:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145353088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175585.149778:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175585.149782:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175585.149785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145353088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175585.149792:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145353216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175585.149814:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175585.149825:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe65f80 x1872931145353216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175585.149836:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145353216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175585.149843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175585.149845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175585.149848:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145353216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175585.149853:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145353344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175585.149867:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175585.149875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe67b80 x1872931145353344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175585.149885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145353344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175585.149892:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175585.149894:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175585.149897:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145353344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175585.149901:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145353472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175585.149914:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175585.149922:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe65180 x1872931145353472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175585.149959:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145353472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175585.149966:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175585.149969:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175585.149972:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145353472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175585.149977:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145353600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175585.149994:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175585.150003:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe67800 x1872931145353600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175585.150014:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145353600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175585.150021:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175585.150024:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175585.150026:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145353600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175585.150045:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145353728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175585.150059:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175585.150067:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe64380 x1872931145353728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175585.150077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145353728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175585.150084:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175585.150087:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175585.150089:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145353728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175585.150094:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145353856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175585.150107:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175585.150115:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175585/real 1786175585]  req@ffff89d99fe66d80 x1872931145353856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175585.150124:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145353856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175585.150155:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175585.150159:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175585.150163:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145353856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175585.661026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175585.661108:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175586.172979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175586.684977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175586.685027:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175587.197108:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175587.708999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175587.709064:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175588.221006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175588.732988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175588.733090:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175589.245061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175589.757061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175589.757152:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175590.268975:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175590.268979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175590.268986:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175590.268990:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175590.269000:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00080000:3.0:1786175590.269009:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175590.269017:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175590.269052:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145353984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175590.269074:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175590.269078:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175590.269091:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175590.269096:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00080000:3.0:1786175590.269100:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175590.269105:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175590.269115:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175590.269118:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145353984:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175590.269130:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145354112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175590.269140:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175590.269143:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175590.269145:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175590.269149:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00080000:3.0:1786175590.269152:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175590.269155:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175590.269159:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175590.269170:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145354240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175590.269179:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175590.269182:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175590.269184:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175590.269187:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00080000:3.0:1786175590.269190:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175590.269194:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175590.269199:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175590.269208:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145354368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175590.269217:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175590.269220:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175590.269222:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175590.269226:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00080000:3.0:1786175590.269231:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175590.269232:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145354112:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175590.269235:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175590.269239:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175590.269249:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145354496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175590.269261:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145354240:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175590.269271:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175590.269274:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175590.269276:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175590.269281:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00100000:0.0:1786175590.269284:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145354368:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175590.269284:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175590.269288:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175590.269293:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175590.269303:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145354624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175590.269308:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145354496:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175590.269313:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175590.269317:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175590.269318:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175590.269322:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00080000:3.0:1786175590.269326:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175590.269330:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175590.269333:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145354624:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175590.269334:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175590.269344:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145354752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175590.269362:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175590.269366:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175590.269368:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175590.269373:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00080000:3.0:1786175590.269378:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175590.269382:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175590.269387:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175590.269388:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145354752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175590.269397:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145354880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175590.269407:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175590.269410:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175590.269412:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175590.269413:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145354880:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175590.269416:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9324
00000100:00080000:3.0:1786175590.269419:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175590.269423:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175590.269427:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175590.269437:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145355008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175590.269468:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145355008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175590.781040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175590.781168:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175591.293047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175591.805023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175591.805230:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175592.317053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175592.828999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175592.829105:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175593.340988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786175593.341165:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786175593.341201:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786175593.341215:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175593.341256:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786175593.341267:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175593.341277:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175593.341286:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175593.341294:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175593.341301:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe64700 x1872931145355008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786175593.341302:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175593.341313:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175593.341326:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175593.341354:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145355008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341368:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341374:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341379:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145355008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175593.341388:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe66300 x1872931145354880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175593.341401:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145354880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341411:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341415:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341420:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145354880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175593.341427:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe65f80 x1872931145354752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175593.341440:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145354752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341448:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341452:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341456:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145354752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175593.341463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe67b80 x1872931145354624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175593.341476:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145354624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341484:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341488:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145354624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175593.341499:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe65180 x1872931145354496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175593.341513:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145354496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341521:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341528:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145354496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175593.341536:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe66d80 x1872931145354112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175593.341550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145354112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341560:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341563:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341567:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145354112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175593.341575:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe64380 x1872931145354240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175593.341588:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145354240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341597:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145354240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175593.341612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe67800 x1872931145354368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175593.341625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145354368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341640:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145354368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175593.341647:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175590/real 1786175593]  req@ffff89d99fe66680 x1872931145353984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175593.341660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145353984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175593.341670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175593.341673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175593.341677:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145353984:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175593.852989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175593.853071:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175594.365066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175594.877011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175594.877179:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175595.389088:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175595.389100:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175595.389105:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175595.389119:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00100000:0.0:1786175595.389128:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175595.389133:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175595.389148:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175595.389190:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145355136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175595.389227:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175595.389233:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175595.389236:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175595.389242:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00080000:3.0:1786175595.389247:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175595.389253:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175595.389264:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175595.389279:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145355264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175595.389293:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145355136:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175595.389297:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175595.389307:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175595.389310:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175595.389315:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00080000:3.0:1786175595.389319:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175595.389323:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175595.389331:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175595.389354:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145355392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175595.389371:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175595.389378:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175595.389385:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175595.389391:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175595.389401:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00080000:3.0:1786175595.389410:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175595.389417:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175595.389428:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175595.389429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe64000 x1872931145355136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175595.389458:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145355520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175595.389461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145355136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175595.389504:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175595.389516:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175595.389522:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175595.389524:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175595.389538:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00080000:2.0:1786175595.389540:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175595.389552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145355136:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175595.389554:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175595.389571:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175595.389581:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175595.389618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145355264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175595.389624:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145355648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175595.389643:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175595.389649:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175595.389652:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175595.389660:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00080000:3.0:1786175595.389666:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175595.389668:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175595.389678:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175595.389687:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175595.389697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe67480 x1872931145355264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175595.389709:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145355776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175595.389732:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175595.389736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145355264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175595.389739:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175595.389746:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175595.389763:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00080000:2.0:1786175595.389768:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175595.389771:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175595.389781:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175595.389785:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175595.389795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145355264:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175595.389798:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175595.389810:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145355392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175595.389822:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145355904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175595.389841:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175595.389848:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175595.389852:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175595.389854:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175595.389865:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00080000:3.0:1786175595.389874:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175595.389882:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe65500 x1872931145355392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175595.389884:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175595.389898:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175595.389947:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145355392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175595.389963:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175595.389969:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175595.389976:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145355392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175595.389984:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145356032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175595.389994:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145355520:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175595.390016:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175595.390022:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175595.390026:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175595.390057:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9329
00000100:00080000:3.0:1786175595.390065:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175595.390072:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175595.390079:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175595.390089:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175595.390101:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe64a80 x1872931145355520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175595.390114:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145356160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175595.390134:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145355520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175595.390169:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175595.390175:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175595.390182:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145355520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175595.390209:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145355648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175595.390241:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175595.390258:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe65880 x1872931145355648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175595.390274:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145355648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175595.390287:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175595.390293:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175595.390299:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145355648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175595.390309:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145355776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175595.390336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175595.390350:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe66a00 x1872931145355776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175595.390366:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145355776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175595.390377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175595.390383:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175595.390387:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145355776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175595.390395:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145355904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175595.390418:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175595.390432:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe67100 x1872931145355904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175595.390446:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145355904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175595.390455:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175595.390459:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175595.390464:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145355904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175595.390472:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145356032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175595.390496:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175595.390510:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe64000 x1872931145356032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175595.390525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145356032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175595.390537:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175595.390541:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175595.390546:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145356032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175595.390554:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145356160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175595.390595:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175595.390608:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175595/real 1786175595]  req@ffff89d99fe66680 x1872931145356160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175595.390623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145356160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175595.390633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175595.390637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175595.390641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145356160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175595.900999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175595.901139:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175596.413002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175596.924978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175596.925093:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175597.437039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175597.949067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175597.949227:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175598.461058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175598.972976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175598.973152:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175599.485169:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175599.997084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175599.997199:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175600.509094:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175600.509110:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786175600.509113:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175600.509119:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175600.509141:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00080000:3.0:1786175600.509161:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175600.509175:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175600.509238:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145356288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175600.509292:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175600.509298:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175600.509322:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175600.509329:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00080000:3.0:1786175600.509337:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175600.509345:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175600.509361:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145356288:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175600.509361:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175600.509393:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145356416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175600.509413:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175600.509419:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175600.509422:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175600.509430:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00080000:3.0:1786175600.509444:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175600.509451:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786175600.509457:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175600.509473:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175600.509498:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145356544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175600.509514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe67800 x1872931145356288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175600.509518:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175600.509545:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175600.509555:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175600.509569:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00100000:2.0:1786175600.509570:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145356288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175600.509581:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175600.509592:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175600.509607:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175600.509609:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175600.509616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175600.509626:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145356288:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175600.509644:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145356672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175600.509660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145356416:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175600.509672:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175600.509680:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175600.509684:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175600.509692:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175600.509695:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00080000:3.0:1786175600.509707:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175600.509713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe64380 x1872931145356416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175600.509720:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175600.509743:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175600.509752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145356416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175600.509763:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175600.509774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175600.509777:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145356800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175600.509783:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145356416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175600.509811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145356544:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175600.509830:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175600.509837:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175600.509841:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175600.509849:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175600.509859:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00100000:2.0:1786175600.509868:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe66d80 x1872931145356544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175600.509872:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175600.509892:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175600.509941:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175600.509961:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145356544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175600.509969:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145356928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175600.510004:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175600.510018:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175600.510030:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145356544:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175600.510032:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175600.510053:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175600.510057:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175600.510067:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00100000:2.0:1786175600.510074:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145356672:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175600.510080:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175600.510091:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175600.510104:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175600.510115:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175600.510132:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe65180 x1872931145356672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175600.510139:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145357056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175600.510175:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145356672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175600.510178:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175600.510200:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175600.510209:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175600.510223:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00080000:2.0:1786175600.510227:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175600.510231:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175600.510239:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175600.510247:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175600.510255:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145356672:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786175600.510262:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175600.510268:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145356800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175600.510290:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145357184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175600.510308:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175600.510325:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175600.510328:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe67b80 x1872931145356800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175600.510344:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175600.510356:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175600.510365:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145356800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175600.510372:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9334
00000100:00080000:3.0:1786175600.510394:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175600.510415:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175600.510415:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175600.510436:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175600.510438:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175600.510443:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145356800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175600.510461:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145356928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175600.510475:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145357312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175600.510487:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175600.510502:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe65f80 x1872931145356928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175600.510520:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145356928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175600.510528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175600.510533:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175600.510536:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145356928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175600.510557:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145357056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175600.510572:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175600.510580:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe66300 x1872931145357056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175600.510589:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145357056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175600.510595:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175600.510598:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175600.510601:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145357056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175600.510606:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145357184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175600.510619:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175600.510626:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe64700 x1872931145357184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175600.510635:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145357184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175600.510642:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175600.510644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175600.510647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145357184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175600.510652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145357312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175600.510664:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175600.510671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175600/real 1786175600]  req@ffff89d99fe66d80 x1872931145357312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175600.510680:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145357312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175600.510687:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175600.510689:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175600.510691:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145357312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175601.021072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175601.021155:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175601.533061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175602.045075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175602.045192:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175602.557145:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175603.069107:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175603.069211:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175603.581089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175604.093072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175604.093196:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175604.605035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175605.117078:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175605.117188:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175605.629076:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175605.629077:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175605.629088:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175605.629093:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629103:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00080000:0.0:1786175605.629112:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175605.629120:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175605.629157:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145357440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175605.629185:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175605.629189:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175605.629191:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629194:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00080000:0.0:1786175605.629197:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175605.629200:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175605.629209:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175605.629221:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145357568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175605.629233:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175605.629237:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:2.0:1786175605.629237:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145357440:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175605.629242:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629253:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00080000:0.0:1786175605.629255:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175605.629259:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175605.629263:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175605.629275:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145357696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175605.629284:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175605.629287:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175605.629289:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629292:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00080000:0.0:1786175605.629296:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175605.629298:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175605.629303:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175605.629313:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175605.629315:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145357824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175605.629326:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175605.629330:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175605.629332:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629336:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00080000:0.0:1786175605.629338:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175605.629341:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175605.629345:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175605.629357:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145357952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175605.629365:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f2680 x1872931145357440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175605.629387:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175605.629399:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175605.629405:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629415:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00080000:0.0:1786175605.629421:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175605.629431:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175605.629431:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145357440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175605.629444:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175605.629459:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.629466:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.629473:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145357440:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175605.629482:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145358080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175605.629495:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175605.629499:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175605.629521:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629527:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00100000:2.0:1786175605.629533:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145357568:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175605.629536:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175605.629548:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175605.629556:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175605.629575:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145358208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175605.629607:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175605.629612:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175605.629618:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175605.629621:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629629:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00080000:0.0:1786175605.629635:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175605.629636:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f1500 x1872931145357568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175605.629647:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175605.629677:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175605.629691:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145357568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175605.629707:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145358336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175605.629709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.629723:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.629733:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145357568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175605.629742:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145357696:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175605.629771:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175605.629794:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1786175605.629799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175605.629800:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175605.629809:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9339
00000100:00080000:0.0:1786175605.629815:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175605.629820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f0700 x1872931145357696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175605.629823:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175605.629832:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175605.629849:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145358464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175605.629857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145357696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175605.629875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.629881:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.629887:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145357696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175605.629894:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145357824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175605.629917:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175605.629926:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f2d80 x1872931145357824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175605.629977:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145357824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175605.629994:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.629997:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.630000:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145357824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175605.630006:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145357952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175605.630025:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175605.630034:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f2a00 x1872931145357952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175605.630044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145357952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175605.630051:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.630053:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.630056:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145357952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175605.630061:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145358080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175605.630073:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175605.630080:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f3480 x1872931145358080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175605.630089:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145358080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175605.630095:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.630098:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.630100:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145358080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175605.630129:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145358208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175605.630144:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175605.630157:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f3100 x1872931145358208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175605.630171:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145358208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175605.630182:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.630186:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.630191:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145358208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175605.630199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145358336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175605.630225:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175605.630237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f0e00 x1872931145358336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175605.630247:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145358336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175605.630254:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.630257:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.630259:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145358336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175605.630265:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145358464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175605.630278:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175605.630286:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175605/real 1786175605]  req@ffff89d9870f1880 x1872931145358464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175605.630296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145358464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175605.630302:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175605.630304:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175605.630307:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145358464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175606.141066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175606.141155:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175606.652995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175607.165049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175607.165212:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175607.677021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175608.189001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175608.189142:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175608.701038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175609.213042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175609.213151:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175609.725043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175610.237032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175610.237119:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175610.749000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175610.749047:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175610.749057:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175610.749063:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175610.749075:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9344
00000100:00080000:0.0:1786175610.749088:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175610.749097:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175610.749142:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145358592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175610.749177:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175610.749183:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175610.749185:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175610.749190:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9344
00000100:00080000:0.0:1786175610.749194:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175610.749198:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175610.749210:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175610.749225:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145358720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175610.749239:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145358592:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175610.749244:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175610.749254:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175610.749257:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175610.749263:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9344
00000100:00080000:0.0:1786175610.749267:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175610.749272:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175610.749278:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175610.749316:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145358848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175610.749336:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175610.749343:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175610.749347:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175610.749357:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175610.749367:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9344
00000100:00080000:0.0:1786175610.749380:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175610.749390:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175610.749404:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175610.749419:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f1180 x1872931145358592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175610.749436:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145358976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175610.749455:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145358592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175610.749457:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175610.749473:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175610.749498:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175610.749513:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9344
00000100:00080000:2.0:1786175610.749515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175610.749519:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175610.749524:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175610.749531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145358592:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175610.749546:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175610.749554:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175610.749570:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145358720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175610.749575:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145359104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175610.749593:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175610.749599:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175610.749602:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175610.749607:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9344
00000800:00000100:2.0:1786175610.749616:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175610.749618:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175610.749628:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175610.749636:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175610.749644:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f0a80 x1872931145358720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175610.749659:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145359232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175610.749671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145358720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175610.749683:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175610.749695:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175610.749706:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175610.749710:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175610.749711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175610.749723:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145358720:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175610.749727:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9344
00000100:00080000:0.0:1786175610.749736:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175610.749741:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145358848:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175610.749747:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175610.749759:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175610.749779:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145359360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175610.749787:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175610.749806:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175610.749811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f3b80 x1872931145358848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175610.749812:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175610.749819:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175610.749834:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9344
00000100:00080000:0.0:1786175610.749842:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175610.749846:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145358848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175610.749853:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175610.749865:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175610.749940:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145359488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175610.749951:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175610.749955:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175610.749963:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175610.749965:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175610.749973:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175610.749979:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145358848:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175610.749987:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9344
00000100:00080000:0.0:1786175610.749995:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175610.750000:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145358976:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175610.750007:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175610.750018:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175610.750042:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145359616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175610.750058:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175610.750087:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f1880 x1872931145358976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175610.750111:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145358976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175610.750127:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175610.750133:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175610.750138:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145358976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175610.750165:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145359104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175610.750193:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175610.750207:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f0e00 x1872931145359104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175610.750220:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145359104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175610.750229:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175610.750233:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175610.750237:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145359104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175610.750244:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145359232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175610.750262:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175610.750271:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f3100 x1872931145359232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175610.750284:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145359232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175610.750312:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175610.750315:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175610.750319:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145359232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175610.750325:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145359360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175610.750345:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175610.750357:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f3480 x1872931145359360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175610.750388:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145359360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175610.750397:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175610.750400:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175610.750403:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145359360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175610.750409:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145359488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175610.750428:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175610.750439:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f2a00 x1872931145359488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175610.750452:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145359488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175610.750461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175610.750464:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175610.750468:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145359488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175610.750474:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145359616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175610.750491:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175610.750500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175610/real 1786175610]  req@ffff89d9870f2d80 x1872931145359616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175610.750513:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145359616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175610.750522:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175610.750525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175610.750529:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145359616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175611.261011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175611.261116:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175611.773078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175612.285049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175612.285067:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175612.797021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175613.309035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175613.309148:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175613.821068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175614.333040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175614.333173:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175614.844968:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175615.357042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175615.357196:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175615.869094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175615.869103:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175615.869123:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175615.869130:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175615.869144:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00080000:3.0:1786175615.869158:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175615.869170:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175615.869226:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145359744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175615.869274:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175615.869280:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175615.869283:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175615.869288:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00080000:3.0:1786175615.869293:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175615.869299:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175615.869314:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175615.869333:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145359872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175615.869350:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175615.869354:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175615.869357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175615.869364:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00080000:3.0:1786175615.869372:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175615.869378:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175615.869384:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175615.869408:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145360000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175615.869429:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175615.869435:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175615.869438:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175615.869443:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145359744:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175615.869445:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00080000:3.0:1786175615.869464:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175615.869472:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175615.869480:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175615.869503:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145360128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175615.869649:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175615.869659:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175615.869668:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175615.869673:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175615.869684:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00080000:3.0:1786175615.869695:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175615.869704:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175615.869716:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175615.869740:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145360256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175615.869758:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175615.869771:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe64380 x1872931145359744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175615.869772:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175615.869781:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175615.869813:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00100000:0.0:1786175615.869867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145359744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.869889:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.869939:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175615.869951:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145359744:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175615.869974:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145359872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175615.870024:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175615.870046:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe67800 x1872931145359872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175615.870064:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145359872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.870076:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.870088:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175615.870100:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175615.870101:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145359872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175615.870123:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175615.870139:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175615.870174:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145360000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175615.870220:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175615.870246:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145360384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175615.870269:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175615.870275:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175615.870277:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175615.870283:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00080000:3.0:1786175615.870289:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175615.870293:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175615.870302:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175615.870317:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145360512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175615.870328:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175615.870332:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175615.870334:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175615.870338:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00080000:3.0:1786175615.870341:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175615.870345:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175615.870349:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175615.870360:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145360640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175615.870374:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe66680 x1872931145360000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175615.870376:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175615.870389:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175615.870394:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175615.870409:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9350
00000100:00080000:3.0:1786175615.870418:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175615.870422:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175615.870427:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175615.870441:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145360768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175615.870454:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145360000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.870483:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.870493:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175615.870528:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145360000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175615.870545:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145360128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175615.870631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175615.870661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe64000 x1872931145360128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175615.870678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145360128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.870689:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.870693:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175615.870698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145360128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175615.870706:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145360256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175615.870728:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175615.870740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe67100 x1872931145360256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175615.870764:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145360256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.870774:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.870777:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175615.870781:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145360256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175615.870813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145360384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175615.870858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175615.870878:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe66a00 x1872931145360384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175615.870938:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145360384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.870952:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.870957:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175615.870961:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145360384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175615.870969:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145360512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175615.870996:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175615.871011:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe65880 x1872931145360512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175615.871026:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145360512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.871044:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.871048:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175615.871052:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145360512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175615.871058:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145360640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175615.871077:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175615.871087:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe64a80 x1872931145360640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175615.871101:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145360640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.871111:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.871114:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175615.871117:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145360640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175615.871123:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145360768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175615.871140:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175615.871150:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175615/real 1786175615]  req@ffff89d99fe65500 x1872931145360768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175615.871163:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145360768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175615.871173:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175615.871176:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175615.871181:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145360768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175616.381030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175616.381164:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175616.893149:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175617.405137:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175617.405153:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175617.916960:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175618.429036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175618.429069:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175618.940983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175619.453047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175619.453179:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175619.965021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175620.477043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175620.477152:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175620.988977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175620.989006:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175620.989019:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175620.989026:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175620.989043:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00080000:3.0:1786175620.989059:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989072:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175620.989137:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145360896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175620.989177:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175620.989183:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175620.989187:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175620.989193:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00080000:3.0:1786175620.989199:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989206:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175620.989222:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175620.989239:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145360896:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175620.989245:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145361024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175620.989259:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175620.989263:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175620.989265:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175620.989271:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00080000:3.0:1786175620.989275:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989280:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175620.989288:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175620.989302:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145361152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175620.989314:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175620.989319:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175620.989321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175620.989325:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00080000:3.0:1786175620.989330:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989335:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175620.989342:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175620.989343:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175620.989354:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145361280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175620.989366:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175620.989370:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175620.989373:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175620.989378:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00080000:3.0:1786175620.989382:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989387:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175620.989393:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175620.989406:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145361408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175620.989408:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe67480 x1872931145360896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175620.989421:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175620.989425:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175620.989428:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175620.989433:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00100000:0.0:1786175620.989434:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145360896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175620.989438:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989444:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175620.989450:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175620.989451:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175620.989457:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175620.989463:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145360896:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175620.989463:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145361536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175620.989476:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175620.989481:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175620.989484:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175620.989489:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00080000:3.0:1786175620.989493:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989498:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175620.989506:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175620.989513:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145361024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175620.989519:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145361664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175620.989533:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175620.989537:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175620.989540:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175620.989545:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175620.989546:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00080000:3.0:1786175620.989551:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989556:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175620.989563:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175620.989564:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe65500 x1872931145361024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175620.989578:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145361792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175620.989582:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145361024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175620.989593:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175620.989595:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175620.989599:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175620.989600:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175620.989602:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175620.989605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145361024:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175620.989608:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9355
00000100:00100000:0.0:1786175620.989613:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145361152:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175620.989626:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175620.989632:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175620.989639:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175620.989644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175620.989654:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145361920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175620.989660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe64a80 x1872931145361152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175620.989678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145361152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175620.989690:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175620.989695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175620.989700:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145361152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175620.989709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145361280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175620.989738:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175620.989750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe65880 x1872931145361280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175620.989762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145361280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175620.989770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175620.989773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175620.989776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145361280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175620.989781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145361408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175620.989823:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175620.989834:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe66a00 x1872931145361408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175620.989852:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145361408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175620.989860:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175620.989862:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175620.989865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145361408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175620.989870:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145361536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175620.989885:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175620.989894:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe67100 x1872931145361536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175620.989930:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145361536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175620.989937:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175620.989941:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175620.989944:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145361536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175620.989963:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145361664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175620.989981:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175620.989992:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe64000 x1872931145361664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175620.990003:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145361664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175620.990016:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175620.990019:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175620.990022:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145361664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175620.990027:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145361792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175620.990040:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175620.990048:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe66680 x1872931145361792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175620.990058:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145361792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175620.990066:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175620.990068:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175620.990070:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145361792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175620.990075:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145361920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175620.990102:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175620.990111:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175620/real 1786175620]  req@ffff89d99fe67800 x1872931145361920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175620.990123:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145361920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175645 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175620.990130:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175620.990132:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175620.990136:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145361920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175621.501040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175621.501212:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175622.013020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175622.525047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175622.525188:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175623.037019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175623.549071:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175623.549163:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175624.061071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175624.573061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175624.573136:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175625.084980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175625.597077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175625.597130:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175626.109030:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175626.109048:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175626.109056:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175626.109076:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175626.109076:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00080000:3.0:1786175626.109096:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175626.109111:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175626.109159:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145362048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175626.109199:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175626.109208:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175626.109212:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175626.109220:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00080000:3.0:1786175626.109228:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175626.109236:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175626.109263:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175626.109276:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145362048:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175626.109320:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145362176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175626.109340:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175626.109346:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175626.109349:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175626.109356:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00080000:3.0:1786175626.109361:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175626.109368:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175626.109370:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175626.109377:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175626.109396:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145362304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175626.109412:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175626.109419:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175626.109422:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175626.109428:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00100000:0.0:1786175626.109432:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe64380 x1872931145362048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175626.109435:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175626.109442:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175626.109451:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175626.109463:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145362048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175626.109469:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145362432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175626.109485:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175626.109488:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175626.109492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175626.109494:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175626.109508:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175626.109511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145362048:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175626.109531:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00080000:3.0:1786175626.109538:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175626.109545:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175626.109548:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145362176:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175626.109553:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175626.109581:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145362560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175626.109598:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175626.109601:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175626.109607:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175626.109611:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175626.109618:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00100000:0.0:1786175626.109622:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe66d80 x1872931145362176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175626.109624:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175626.109631:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175626.109640:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175626.109647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145362176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175626.109658:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145362688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175626.109665:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175626.109672:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175626.109676:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175626.109678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145362176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175626.109683:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175626.109687:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175626.109690:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145362304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175626.109694:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00080000:3.0:1786175626.109710:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175626.109716:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175626.109724:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175626.109733:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175626.109779:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145362816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175626.109796:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe64700 x1872931145362304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175626.109804:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175626.109811:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175626.109815:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175626.109821:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145362304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175626.109823:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00080000:3.0:1786175626.109829:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175626.109837:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175626.109837:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175626.109844:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175626.109847:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175626.109851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145362304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175626.109863:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145362432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175626.109865:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145362944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175626.109883:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175626.109889:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175626.109892:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175626.109944:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175626.109948:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9360
00000100:00080000:3.0:1786175626.109956:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175626.109963:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175626.109969:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe66300 x1872931145362432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175626.109973:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175626.109998:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145362432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175626.109998:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145363072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175626.110025:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175626.110031:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175626.110037:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145362432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175626.110069:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145362560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175626.110111:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175626.110130:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe65f80 x1872931145362560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175626.110146:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145362560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175626.110157:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175626.110161:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175626.110165:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145362560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175626.110172:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145362688:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175626.110195:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175626.110206:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe67b80 x1872931145362688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175626.110220:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145362688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175626.110229:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175626.110233:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175626.110236:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145362688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175626.110242:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145362816:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175626.110260:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175626.110271:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe65180 x1872931145362816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175626.110288:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145362816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175626.110298:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175626.110302:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175626.110306:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145362816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175626.110313:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145362944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175626.110331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175626.110341:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe64380 x1872931145362944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175626.110355:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145362944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175626.110365:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175626.110368:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175626.110372:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145362944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175626.110378:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145363072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175626.110395:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175626.110406:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175626/real 1786175626]  req@ffff89d99fe67800 x1872931145363072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175626.110419:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145363072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175626.110429:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175626.110432:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175626.110436:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145363072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175626.621043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175626.621179:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175627.133020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175627.644958:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175627.645050:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175628.157027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175628.669037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175628.669149:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175629.181089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175629.693004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175629.693133:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175630.205022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175630.717038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175630.717178:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175631.229060:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175631.229065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175631.229083:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175631.229093:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175631.229110:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00080000:3.0:1786175631.229127:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175631.229139:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175631.229206:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145363200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175631.229255:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175631.229261:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175631.229263:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175631.229269:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00080000:3.0:1786175631.229275:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175631.229280:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175631.229295:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175631.229315:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145363328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175631.229338:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145363200:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175631.229346:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175631.229357:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175631.229361:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175631.229368:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00080000:3.0:1786175631.229373:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175631.229379:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175631.229387:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175631.229401:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145363456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175631.229415:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175631.229420:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175631.229422:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175631.229428:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00080000:3.0:1786175631.229433:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175631.229437:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175631.229444:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175631.229445:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175631.229468:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145363584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175631.229480:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175631.229485:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175631.229489:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175631.229495:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00080000:3.0:1786175631.229500:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175631.229510:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175631.229513:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe66680 x1872931145363200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175631.229518:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175631.229549:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145363712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175631.229559:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145363200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175631.229605:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175631.229616:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175631.229618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175631.229620:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175631.229631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175631.229634:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00080000:3.0:1786175631.229641:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175631.229642:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145363200:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175631.229656:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175631.229666:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175631.229682:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145363840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175631.229728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145363328:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175631.229760:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175631.229774:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175631.229777:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175631.229782:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175631.229793:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00100000:0.0:1786175631.229802:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe64000 x1872931145363328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175631.229802:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175631.229821:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175631.229845:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175631.229856:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145363328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175631.229873:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175631.229876:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145363968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175631.229885:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175631.229929:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145363328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175631.229940:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145363456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175631.229970:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175631.229976:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175631.229980:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175631.229993:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175631.230000:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00080000:3.0:1786175631.230010:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175631.230017:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175631.230023:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe67100 x1872931145363456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175631.230028:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175631.230066:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145364096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175631.230077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145363456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175631.230117:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175631.230129:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175631.230130:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175631.230139:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175631.230143:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175631.230154:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9365
00000100:00100000:0.0:1786175631.230156:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145363456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175631.230163:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175631.230171:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175631.230172:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145363584:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786175631.230188:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175631.230208:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145364224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175631.230220:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175631.230256:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe66a00 x1872931145363584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175631.230273:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145363584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175631.230283:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175631.230287:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175631.230290:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145363584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175631.230296:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145363712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175631.230326:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175631.230343:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe65880 x1872931145363712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175631.230363:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145363712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175631.230385:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175631.230389:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175631.230392:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145363712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175631.230414:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145363840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175631.230437:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175631.230449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe64a80 x1872931145363840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175631.230460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145363840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175631.230467:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175631.230470:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175631.230473:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145363840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175631.230478:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145363968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175631.230493:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175631.230501:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe65500 x1872931145363968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175631.230512:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145363968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175631.230519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175631.230522:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175631.230525:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145363968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175631.230530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145364096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175631.230543:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175631.230551:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe67480 x1872931145364096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175631.230561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145364096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175631.230568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175631.230571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175631.230574:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145364096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175631.230580:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145364224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175631.230592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175631.230600:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175631/real 1786175631]  req@ffff89d99fe66680 x1872931145364224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175631.230611:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145364224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175631.230618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175631.230621:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175631.230624:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145364224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175631.741018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175631.741100:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175632.252966:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175632.764992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175632.765066:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175633.276970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175633.789032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175633.789172:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175634.301042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175634.813035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175634.813137:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175635.325072:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175635.837020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175635.837150:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175636.349024:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175636.349044:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175636.349052:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175636.349059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175636.349091:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00080000:2.0:1786175636.349109:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175636.349125:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175636.349198:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145364352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175636.349239:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175636.349244:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175636.349247:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175636.349252:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00080000:2.0:1786175636.349260:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175636.349269:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175636.349286:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175636.349299:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145364352:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175636.349318:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145364480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175636.349359:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175636.349364:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175636.349367:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175636.349374:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00080000:2.0:1786175636.349381:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175636.349390:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175636.349393:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175636.349406:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175636.349428:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145364608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175636.349442:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175636.349446:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175636.349449:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175636.349454:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00080000:2.0:1786175636.349459:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175636.349464:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175636.349471:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175636.349478:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87ca80 x1872931145364352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175636.349491:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145364736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175636.349525:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175636.349530:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175636.349533:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175636.349543:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00100000:0.0:1786175636.349544:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145364352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175636.349547:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175636.349561:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175636.349576:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175636.349578:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175636.349589:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175636.349596:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145364352:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175636.349610:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145364864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175636.349633:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145364480:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175636.349657:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175636.349667:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175636.349671:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175636.349678:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00080000:2.0:1786175636.349689:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175636.349699:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175636.349710:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175636.349716:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175636.349745:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87e680 x1872931145364480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175636.349753:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145364992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175636.349799:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175636.349807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145364480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175636.349808:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175636.349822:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175636.349824:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175636.349835:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175636.349840:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00100000:0.0:1786175636.349849:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145364480:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175636.349853:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175636.349862:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145364608:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175636.349872:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175636.349887:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175636.349936:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175636.349957:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87ed80 x1872931145364608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175636.349985:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145364608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175636.349986:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145365120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175636.350037:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175636.350047:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175636.350048:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175636.350054:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175636.350061:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175636.350069:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00100000:0.0:1786175636.350077:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145364608:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175636.350081:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175636.350089:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145364736:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175636.350094:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175636.350104:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175636.350125:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145365248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175636.350135:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175636.350156:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87d880 x1872931145364736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175636.350164:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175636.350178:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175636.350183:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175636.350194:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9370
00000100:00100000:0.0:1786175636.350199:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145364736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175636.350203:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175636.350216:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175636.350223:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175636.350227:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175636.350233:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175636.350240:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145364736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175636.350258:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145365376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175636.350275:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145364864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175636.350308:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175636.350327:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87f100 x1872931145364864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175636.350342:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145364864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175636.350352:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175636.350355:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175636.350359:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145364864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175636.350366:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145364992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175636.350385:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175636.350402:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87d500 x1872931145364992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175636.350423:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145364992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175636.350439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175636.350445:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175636.350451:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145364992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175636.350463:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145365120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175636.350498:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175636.350515:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87df80 x1872931145365120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175636.350530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145365120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175636.350539:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175636.350543:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175636.350546:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145365120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175636.350553:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145365248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175636.350572:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175636.350583:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87f800 x1872931145365248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175636.350596:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145365248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175636.350605:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175636.350608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175636.350611:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145365248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175636.350631:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145365376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175636.350689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175636.350711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175636/real 1786175636]  req@ffff89d99e87dc00 x1872931145365376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175636.350734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145365376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175636.350751:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175636.350757:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175636.350764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145365376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175636.861028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175636.861171:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175637.372982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175637.885085:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175637.885141:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175638.396997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175638.909018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175638.909119:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175639.421063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175639.933063:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175639.933173:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175640.444977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175640.956974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175640.957042:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175641.468975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175641.468975:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175641.468984:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175641.468988:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175641.468996:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00080000:2.0:1786175641.469005:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175641.469011:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175641.469045:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145365504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175641.469067:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175641.469070:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175641.469071:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175641.469074:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00080000:2.0:1786175641.469076:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175641.469079:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175641.469087:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175641.469097:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145365632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175641.469102:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145365504:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175641.469108:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175641.469111:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175641.469112:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175641.469116:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00080000:2.0:1786175641.469118:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175641.469120:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175641.469124:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175641.469131:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145365760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175641.469138:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175641.469141:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175641.469142:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175641.469144:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00080000:2.0:1786175641.469147:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175641.469149:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175641.469153:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175641.469160:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145365888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175641.469163:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175641.469171:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175641.469175:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175641.469177:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175641.469181:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00080000:2.0:1786175641.469184:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175641.469186:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175641.469189:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175641.469196:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145366016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175641.469203:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175641.469204:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87c000 x1872931145365504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175641.469207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175641.469211:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175641.469217:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00080000:2.0:1786175641.469221:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175641.469225:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175641.469228:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175641.469229:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145365504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175641.469237:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145366144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175641.469242:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175641.469247:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175641.469250:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175641.469252:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175641.469255:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175641.469258:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145365504:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175641.469261:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00080000:2.0:1786175641.469266:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175641.469268:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175641.469271:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175641.469287:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145366272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175641.469292:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145365632:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175641.469298:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175641.469301:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175641.469302:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175641.469305:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00080000:2.0:1786175641.469309:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175641.469312:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175641.469316:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175641.469316:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175641.469329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145366400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175641.469330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87c700 x1872931145365632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175641.469361:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175641.469362:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145365632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175641.469372:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175641.469376:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175641.469377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175641.469385:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175641.469388:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9375
00000100:00100000:0.0:1786175641.469391:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145365632:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175641.469395:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175641.469398:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145365760:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175641.469402:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175641.469408:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175641.469418:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175641.469422:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145366528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175641.469430:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87c380 x1872931145365760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175641.469441:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145365760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175641.469447:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175641.469450:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175641.469452:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145365760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175641.469456:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145365888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175641.469468:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175641.469473:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87dc00 x1872931145365888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175641.469481:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145365888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175641.469486:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175641.469488:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175641.469490:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145365888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175641.469493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145366016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175641.469502:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175641.469507:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87f800 x1872931145366016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175641.469514:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145366016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175641.469519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175641.469520:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175641.469522:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145366016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175641.469525:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145366144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175641.469534:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175641.469539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87df80 x1872931145366144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175641.469547:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145366144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175641.469552:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175641.469554:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175641.469556:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145366144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175641.469569:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145366272:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175641.469579:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175641.469597:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87d500 x1872931145366272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175641.469605:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145366272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175641.469610:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175641.469612:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175641.469614:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145366272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175641.469618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145366400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175641.469630:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175641.469636:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87f100 x1872931145366400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175641.469643:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145366400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175641.469653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175641.469655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175641.469657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145366400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175641.469660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145366528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175641.469669:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175641.469675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175641/real 1786175641]  req@ffff89d99e87d880 x1872931145366528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175641.469682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145366528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175641.469687:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175641.469688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175641.469690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145366528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175641.981008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175641.981126:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175642.493022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175643.005016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175643.005146:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175643.517021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175644.029008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175644.029068:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175644.541075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175645.053081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175645.053143:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175645.565015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175646.076990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175646.077049:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175646.588983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175646.589002:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175646.589007:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175646.589011:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175646.589019:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589027:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175646.589033:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175646.589067:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145366656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175646.589090:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175646.589092:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175646.589094:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175646.589096:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589098:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175646.589100:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175646.589108:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175646.589115:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145366784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175646.589122:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175646.589124:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175646.589125:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175646.589127:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589129:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175646.589131:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175646.589133:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175646.589139:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145366912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175646.589146:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175646.589149:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175646.589150:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175646.589153:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589155:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175646.589157:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175646.589161:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175646.589170:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145366656:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175646.589170:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145367040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175646.589184:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175646.589186:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175646.589187:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175646.589190:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589192:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175646.589194:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175646.589197:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175646.589204:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145367168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175646.589209:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175646.589212:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175646.589213:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175646.589215:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589217:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175646.589220:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175646.589223:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175646.589239:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145367296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175646.589245:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175646.589249:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000800:00000100:0.0:1786175646.589250:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175646.589251:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175646.589257:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589259:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175646.589262:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175646.589266:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175646.589274:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145367424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175646.589280:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175646.589283:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175646.589284:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175646.589288:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589291:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175646.589295:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2ff800 x1872931145366656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175646.589296:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175646.589304:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175646.589321:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145367552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175646.589322:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145366656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589346:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175646.589348:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175646.589353:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589359:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145366656:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175646.589364:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175646.589369:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175646.589370:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145366784:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175646.589378:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9380
00000100:00080000:1.0:1786175646.589382:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175646.589385:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175646.589390:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175646.589405:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175646.589405:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145367680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175646.589426:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2ffb80 x1872931145366784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175646.589442:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145366784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589452:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175646.589455:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589459:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145366784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175646.589465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145366912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175646.589482:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175646.589490:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2ff100 x1872931145366912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175646.589498:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145366912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589503:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175646.589505:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589507:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145366912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175646.589526:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145367040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175646.589551:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175646.589560:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2fea00 x1872931145367040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175646.589568:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145367040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175646.589575:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589577:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145367040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175646.589580:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145367168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175646.589591:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175646.589597:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2fd500 x1872931145367168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175646.589604:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145367168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589609:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175646.589610:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589612:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145367168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175646.589615:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145367296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175646.589625:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175646.589630:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2fc380 x1872931145367296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175646.589636:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145367296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589642:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175646.589643:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145367296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175646.589648:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145367424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175646.589658:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175646.589663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2fe300 x1872931145367424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175646.589670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145367424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175646.589676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145367424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175646.589681:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145367552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175646.589691:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175646.589696:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2fdf80 x1872931145367552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175646.589702:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145367552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175646.589709:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145367552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175646.589715:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145367680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175646.589724:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175646.589729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175646/real 1786175646]  req@ffff89d9ba2fed80 x1872931145367680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175646.589736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145367680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175646.589740:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175646.589743:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175646.589744:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145367680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175647.100973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175647.101017:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175647.613080:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175648.125085:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175648.125192:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175648.637082:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175649.149089:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175649.149133:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175649.661044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175650.173068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175650.173174:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175650.684992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175651.196972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175651.197029:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175651.709062:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175651.709159:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175651.709177:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175651.709186:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175651.709207:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.709228:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175651.709244:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175651.709324:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145367808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175651.709378:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175651.709384:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175651.709408:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175651.709416:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.709424:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175651.709432:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175651.709446:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175651.709455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145367808:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175651.709472:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145367936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175651.709512:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175651.709517:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175651.709520:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175651.709546:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.709553:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175651.709559:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175651.709570:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175651.709584:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175651.709604:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145368064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175651.709630:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175651.709638:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175651.709642:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175651.709655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f0700 x1872931145367808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175651.709656:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.709680:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175651.709698:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175651.709700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145367808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175651.709722:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175651.709727:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175651.709734:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.709742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145367808:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175651.709769:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145368192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175651.709796:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175651.709803:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145367936:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175651.709805:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175651.709814:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175651.709823:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.709829:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175651.709836:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175651.709846:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175651.709853:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175651.709874:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145368320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175651.709885:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f1500 x1872931145367936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175651.709901:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175651.709909:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175651.709912:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175651.709922:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.709957:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175651.709960:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145367936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175651.709972:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175651.709978:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175651.709989:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175651.709992:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.710010:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145367936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175651.710033:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145368448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175651.710033:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145368064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175651.710075:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175651.710083:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175651.710089:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175651.710099:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175651.710106:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.710119:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175651.710126:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f2680 x1872931145368064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175651.710128:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175651.710141:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175651.710155:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145368064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175651.710186:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145368576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175651.710187:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175651.710209:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.710233:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145368064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175651.710238:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175651.710248:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175651.710252:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175651.710263:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.710269:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175651.710274:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145368192:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175651.710283:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175651.710300:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175651.710330:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145368704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175651.710330:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175651.710351:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f2d80 x1872931145368192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175651.710352:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175651.710381:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175651.710392:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175651.710416:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145368192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175651.710425:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9385
00000100:00080000:0.0:1786175651.710437:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175651.710454:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175651.710475:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786175651.710486:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175651.710513:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.710525:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145368192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175651.710540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145368320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175651.710547:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145368832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175651.710593:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175651.710621:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f2a00 x1872931145368320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175651.710644:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145368320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175651.710669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175651.710676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.710682:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145368320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175651.710694:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145368448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175651.710725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175651.710738:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f3480 x1872931145368448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175651.710752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145368448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175651.710761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175651.710764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.710778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145368448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175651.710784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145368576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175651.710802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175651.710811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f3100 x1872931145368576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175651.710823:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145368576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175651.710851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175651.710854:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.710858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145368576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175651.710880:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145368704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175651.710940:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175651.710957:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f0e00 x1872931145368704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175651.710973:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145368704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175651.710983:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175651.710987:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.710990:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145368704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175651.710997:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145368832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175651.711039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175651.711056:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175651/real 1786175651]  req@ffff89d9870f1880 x1872931145368832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175651.711072:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145368832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175651.711099:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175651.711105:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175651.711108:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145368832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175652.221000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175652.221075:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175652.733004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175653.244989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175653.245074:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175653.757064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175654.269008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175654.269169:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175654.781051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175655.292969:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175655.293058:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175655.805047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175656.317052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175656.317239:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175656.829008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175656.829040:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829047:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175656.829052:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175656.829061:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829070:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175656.829077:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175656.829114:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145368960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175656.829142:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829145:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175656.829147:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175656.829150:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829153:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175656.829156:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175656.829165:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175656.829176:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145369088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175656.829186:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829190:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175656.829193:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175656.829195:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145368960:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175656.829199:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829205:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175656.829211:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175656.829215:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175656.829224:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145369216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175656.829238:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829241:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175656.829243:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175656.829246:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829249:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175656.829252:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175656.829255:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175656.829264:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145369344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175656.829272:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829275:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175656.829277:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175656.829279:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829282:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175656.829285:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175656.829289:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175656.829298:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145369472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175656.829306:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829309:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175656.829311:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175656.829315:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829319:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175656.829324:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175656.829326:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145369088:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175656.829329:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175656.829348:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145369600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175656.829357:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829360:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175656.829362:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175656.829367:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829371:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175656.829374:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175656.829378:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175656.829382:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145369216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175656.829394:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145369728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175656.829404:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829407:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175656.829409:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175656.829412:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829415:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175656.829422:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145369344:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175656.829422:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175656.829430:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175656.829464:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145369856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175656.829478:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175656.829482:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175656.829484:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175656.829489:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145369472:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175656.829492:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9391
00000100:00080000:2.0:1786175656.829498:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175656.829503:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175656.829508:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175656.829521:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145369984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175656.829544:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145369600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175656.829572:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145369728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175656.829594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145369856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175656.829615:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145369984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175657.341023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175657.341094:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175657.853165:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175658.364988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175658.365123:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175658.877084:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175659.388993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175659.389158:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175659.901217:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786175659.901434:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786175659.901486:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786175659.901503:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175659.901570:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786175659.901588:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175659.901603:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175659.901606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87dc00 x1872931145369984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786175659.901617:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175659.901633:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175659.901647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145369984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786175659.901651:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175659.901667:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786175659.901674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.901683:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000800:00000100:2.0:1786175659.901688:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175659.901698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145369984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175659.901708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87e680 x1872931145369088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175659.901733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145369088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175659.901741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.901745:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175659.901749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145369088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175659.901756:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87ca80 x1872931145369216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175659.901768:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145369216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175659.901776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.901780:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175659.901784:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145369216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175659.901790:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87d880 x1872931145369344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175659.901802:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145369344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175659.901817:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.901820:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175659.901824:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145369344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175659.901831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87f100 x1872931145369472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175659.901844:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145369472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175659.901852:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.901855:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175659.901858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145369472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175659.901864:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87ed80 x1872931145368960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175659.901877:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145368960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175659.901885:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.901888:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175659.901891:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145368960:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175659.901958:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87d500 x1872931145369600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175659.901975:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145369600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175659.901987:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.901994:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175659.902006:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145369600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175659.902016:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87df80 x1872931145369728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175659.902030:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145369728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175659.902038:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.902041:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175659.902044:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145369728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175659.902050:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175656/real 1786175659]  req@ffff89d99e87f800 x1872931145369856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175659.902061:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145369856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175659.902068:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175659.902072:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175659.902075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145369856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175660.413060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175660.413186:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175660.925109:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175661.437051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175661.437135:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175661.948992:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175661.949001:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175661.949006:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175661.949016:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00080000:2.0:1786175661.949026:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949032:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175661.949067:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145370112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175661.949070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175661.949097:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175661.949101:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175661.949103:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175661.949106:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00080000:2.0:1786175661.949109:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949112:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175661.949120:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175661.949130:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145370240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175661.949139:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175661.949142:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175661.949144:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175661.949148:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145370112:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175661.949150:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00080000:2.0:1786175661.949159:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949163:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175661.949167:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175661.949180:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145370368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175661.949188:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175661.949191:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175661.949193:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175661.949196:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00080000:2.0:1786175661.949200:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949202:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175661.949206:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175661.949215:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145370496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175661.949224:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175661.949228:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175661.949251:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175661.949254:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175661.949262:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00080000:2.0:1786175661.949269:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949274:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175661.949281:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175661.949296:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145370624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175661.949308:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175661.949313:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175661.949316:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175661.949326:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87c380 x1872931145370112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175661.949340:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00080000:2.0:1786175661.949345:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949349:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175661.949360:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175661.949425:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145370752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175661.949432:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145370112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175661.949446:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175661.949452:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175661.949453:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175661.949459:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175661.949463:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175661.949471:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00100000:0.0:1786175661.949475:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145370112:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175661.949479:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949488:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175661.949496:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175661.949509:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145370240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175661.949515:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145370880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175661.949531:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175661.949536:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175661.949538:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175661.949546:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175661.949547:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00080000:2.0:1786175661.949556:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949563:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175661.949570:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175661.949571:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87c700 x1872931145370240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175661.949594:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145371008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175661.949595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145370240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175661.949634:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175661.949637:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175661.949642:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175661.949646:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175661.949652:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145370240:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175661.949653:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175661.949667:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9396
00000100:00100000:0.0:1786175661.949671:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145370368:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175661.949675:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175661.949684:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175661.949691:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175661.949709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175661.949711:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145371136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175661.949731:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87c000 x1872931145370368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175661.949750:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145370368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175661.949761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175661.949765:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175661.949768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145370368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175661.949775:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145370496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175661.949800:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175661.949814:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87f800 x1872931145370496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175661.949828:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145370496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175661.949836:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175661.949839:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175661.949843:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145370496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175661.949850:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145370624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175661.949872:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175661.949884:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87df80 x1872931145370624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175661.949923:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145370624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175661.949933:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175661.949937:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175661.949941:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145370624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175661.949947:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145370752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175661.949970:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175661.949984:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87d500 x1872931145370752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175661.949998:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145370752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175661.950008:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175661.950012:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175661.950016:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145370752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175661.950042:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145370880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175661.950065:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175661.950080:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87ed80 x1872931145370880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175661.950094:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145370880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175661.950104:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175661.950108:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175661.950112:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145370880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175661.950120:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145371008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175661.950145:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175661.950160:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87f100 x1872931145371008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175661.950177:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145371008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175661.950187:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175661.950190:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175661.950194:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145371008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175661.950201:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145371136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175661.950222:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175661.950234:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175661/real 1786175661]  req@ffff89d99e87d880 x1872931145371136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175661.950246:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145371136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175661.950255:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175661.950258:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175661.950262:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145371136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175662.460965:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175662.461049:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175662.973083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175663.485119:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175663.485246:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175663.997013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175664.508965:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175664.509025:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175665.021032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175665.533039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175665.533200:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175666.045033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175666.557053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175666.557184:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175667.069071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175667.069195:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175667.069210:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175667.069217:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175667.069233:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.069251:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175667.069262:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175667.069328:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145371264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175667.069406:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175667.069413:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175667.069416:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175667.069421:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.069426:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175667.069432:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175667.069448:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175667.069466:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145371392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175667.069475:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145371264:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175667.069507:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175667.069512:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175667.069514:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175667.069522:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.069525:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175667.069530:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175667.069536:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175667.069552:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145371520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175667.069564:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175667.069569:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175667.069572:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175667.069576:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.069581:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175667.069587:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175667.069594:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175667.069613:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175667.069614:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145371648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175667.069635:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175667.069641:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175667.069644:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175667.069649:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.069654:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175667.069661:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175667.069667:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175667.069681:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145371776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175667.069692:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175667.069697:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175667.069699:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175667.069704:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.069708:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175667.069718:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe67800 x1872931145371264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175667.069718:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175667.069733:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175667.069754:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145371904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175667.069771:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175667.069780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145371264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175667.069783:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175667.069793:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175667.069820:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.069837:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175667.069841:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175667.069845:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175667.069856:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175667.069858:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175667.069879:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145371264:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175667.069891:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145372032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175667.069963:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145371392:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175667.069997:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175667.070002:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175667.070007:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175667.070017:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.070024:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175667.070033:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175667.070045:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175667.070051:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175667.070074:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe64380 x1872931145371392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175667.070076:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145372160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175667.070195:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175667.070200:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175667.070208:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175667.070210:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145371392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175667.070222:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9401
00000100:00080000:3.0:1786175667.070239:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175667.070253:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175667.070254:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175667.070277:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175667.070279:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175667.070303:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145371392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175667.070312:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145372288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175667.070320:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145371520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175667.070405:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175667.070430:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe65180 x1872931145371520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175667.070447:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145371520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175667.070458:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175667.070462:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175667.070467:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145371520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175667.070475:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145371648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175667.070496:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175667.070507:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe67b80 x1872931145371648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175667.070528:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145371648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175667.070546:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175667.070551:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175667.070558:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145371648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175667.070570:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145371776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175667.070609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175667.070632:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe65f80 x1872931145371776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175667.070657:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145371776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175667.070673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175667.070680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175667.070687:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145371776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175667.070700:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145371904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175667.070739:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175667.070757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe66300 x1872931145371904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175667.070772:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145371904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175667.070783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175667.070787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175667.070791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145371904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175667.070820:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145372032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175667.070872:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175667.070887:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe64700 x1872931145372032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175667.070934:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145372032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175667.070945:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175667.070948:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175667.070952:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145372032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175667.070961:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145372160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175667.070984:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175667.070997:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe66d80 x1872931145372160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175667.071011:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145372160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175667.071021:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175667.071025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175667.071028:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145372160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175667.071035:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145372288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175667.071053:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175667.071064:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175667/real 1786175667]  req@ffff89d99fe67800 x1872931145372288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175667.071079:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145372288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175667.071089:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175667.071092:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175667.071096:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145372288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175667.581041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175667.581118:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175668.093039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175668.605047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175668.605157:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175669.117009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175669.628985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175669.629102:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175670.140975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175670.652993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175670.653108:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175671.165005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175671.676995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175671.677194:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175672.189029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175672.189059:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.189073:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175672.189081:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175672.189097:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9406
00000100:00080000:3.0:1786175672.189114:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175672.189126:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175672.189195:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145372416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175672.189236:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.189253:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175672.189256:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175672.189261:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9406
00000100:00080000:3.0:1786175672.189268:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175672.189275:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175672.189311:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175672.189324:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145372416:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175672.189337:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145372544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175672.189379:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.189388:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175672.189392:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175672.189401:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9406
00000100:00080000:3.0:1786175672.189411:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175672.189419:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175672.189423:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175672.189439:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175672.189468:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145372672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175672.189490:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.189496:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175672.189499:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175672.189506:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9406
00000100:00080000:3.0:1786175672.189513:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175672.189516:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe66680 x1872931145372416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175672.189524:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175672.189539:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175672.189564:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145372800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175672.189585:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.189590:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175672.189593:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175672.189603:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9406
00000100:00100000:0.0:1786175672.189606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145372416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175672.189608:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175672.189620:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175672.189630:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175672.189652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175672.189653:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145372928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175672.189673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175672.189676:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.189686:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786175672.189692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145372416:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175672.189693:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175672.189710:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9406
00000100:00080000:3.0:1786175672.189715:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175672.189720:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175672.189725:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175672.189736:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145373056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175672.189747:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.189751:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175672.189754:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175672.189760:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9406
00000100:00100000:0.0:1786175672.189769:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145372544:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175672.189769:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175672.189781:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175672.189792:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175672.189808:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145373184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175672.189823:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.189827:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175672.189831:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175672.189837:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9406
00000800:00000100:0.0:1786175672.189848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175672.189848:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175672.189867:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175672.189874:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175672.189890:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145373312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175672.189943:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe67480 x1872931145372544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175672.190018:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175672.190024:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175672.190031:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175672.190032:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145372544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175672.190045:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9406
00000100:00080000:3.0:1786175672.190062:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175672.190080:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175672.190098:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175672.190101:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175672.190113:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175672.190124:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145372544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175672.190138:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145373440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175672.190144:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145372672:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175672.190218:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175672.190257:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe65500 x1872931145372672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175672.190284:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145372672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175672.190333:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175672.190350:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175672.190357:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145372672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175672.190370:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145372800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175672.190413:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175672.190439:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe64a80 x1872931145372800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175672.190465:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145372800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175672.190482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175672.190488:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175672.190496:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145372800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175672.190507:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145372928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175672.190547:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175672.190581:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe65880 x1872931145372928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175672.190606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145372928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175672.190622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175672.190628:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175672.190635:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145372928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175672.190647:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145373056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175672.190687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175672.190710:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe66a00 x1872931145373056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175672.190737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145373056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175672.190755:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175672.190762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175672.190769:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145373056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175672.190808:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145373184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175672.190851:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175672.190877:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe67100 x1872931145373184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175672.190955:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145373184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175672.190972:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175672.190979:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175672.190986:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145373184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175672.191000:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145373312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175672.191049:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175672.191074:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe64000 x1872931145373312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175672.191099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145373312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175672.191117:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175672.191124:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175672.191130:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145373312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175672.191143:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145373440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175672.191182:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175672.191205:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175672/real 1786175672]  req@ffff89d99fe66680 x1872931145373440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175672.191231:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145373440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175672.191259:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175672.191266:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175672.191272:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145373440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175672.701070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175672.701132:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175673.213050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175673.725051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175673.725148:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175674.237033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175674.749033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175674.749114:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175675.260963:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175675.773013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175675.773118:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175676.284978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175676.797044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175676.797141:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175677.309009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175677.309074:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175677.309082:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175677.309087:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175677.309098:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309108:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175677.309116:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175677.309155:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145373568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175677.309188:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175677.309192:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175677.309195:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175677.309199:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309203:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175677.309207:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175677.309217:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175677.309234:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145373696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175677.309270:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145373568:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175677.309297:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175677.309301:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175677.309304:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175677.309311:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309316:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175677.309321:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175677.309329:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175677.309347:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145373824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175677.309359:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175677.309364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175677.309367:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175677.309371:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175677.309378:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309384:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175677.309389:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175677.309394:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175677.309408:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145373952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175677.309420:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175677.309426:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87ca80 x1872931145373568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175677.309427:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175677.309432:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175677.309453:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309460:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175677.309467:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145373568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175677.309469:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175677.309480:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175677.309503:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175677.309504:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145374080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175677.309523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175677.309525:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175677.309534:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175677.309541:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175677.309542:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145373568:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175677.309550:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309561:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175677.309566:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175677.309571:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175677.309583:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145374208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175677.309594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145373696:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175677.309599:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175677.309605:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175677.309607:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175677.309614:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309618:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175677.309622:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175677.309628:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175677.309641:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175677.309647:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145374336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175677.309667:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87e680 x1872931145373696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175677.309670:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175677.309681:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175677.309685:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175677.309697:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309707:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175677.309712:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175677.309718:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175677.309726:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145373696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175677.309734:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145374464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175677.309754:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175677.309763:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175677.309771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175677.309772:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175677.309780:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175677.309802:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145373696:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175677.309809:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9411
00000100:00080000:2.0:1786175677.309818:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175677.309825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145373824:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175677.309827:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175677.309847:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175677.309869:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145374592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175677.309899:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175677.309925:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87dc00 x1872931145373824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175677.309999:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145373824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175677.310016:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175677.310023:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175677.310029:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145373824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175677.310040:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145373952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175677.310075:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175677.310091:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87d880 x1872931145373952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175677.310104:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145373952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175677.310114:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175677.310117:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175677.310120:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145373952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175677.310127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145374080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175677.310146:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175677.310155:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87f100 x1872931145374080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175677.310168:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145374080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175677.310194:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175677.310197:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175677.310200:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145374080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175677.310223:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145374208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175677.310290:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175677.310305:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87ed80 x1872931145374208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175677.310317:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145374208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175677.310326:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175677.310329:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175677.310333:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145374208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175677.310339:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145374336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175677.310359:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175677.310369:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87d500 x1872931145374336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175677.310381:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145374336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175677.310396:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175677.310399:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175677.310403:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145374336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175677.310408:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145374464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175677.310424:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175677.310433:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87df80 x1872931145374464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175677.310445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145374464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175677.310460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175677.310465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175677.310470:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145374464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175677.310480:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145374592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175677.310513:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175677.310532:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175677/real 1786175677]  req@ffff89d99e87f800 x1872931145374592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175677.310553:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145374592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175677.310563:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175677.310566:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175677.310570:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145374592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175677.821037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175677.821157:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175678.333000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175678.845012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175678.845071:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175679.356982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175679.869008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175679.869288:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175680.381042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175680.893074:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175680.893185:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175681.405047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175681.917053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175681.917144:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175682.429045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175682.429068:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175682.429078:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175682.429083:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175682.429096:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00080000:3.0:1786175682.429106:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.429115:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175682.429161:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145374720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175682.429259:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175682.429267:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175682.429271:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175682.429279:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00080000:3.0:1786175682.429288:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.429297:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175682.429312:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175682.429334:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145374720:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175682.429346:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145374848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175682.429390:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175682.429397:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175682.429400:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175682.429407:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00080000:3.0:1786175682.429417:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.429424:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175682.429434:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175682.429441:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175682.429476:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145374976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175682.429497:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175682.429503:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175682.429507:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175682.429517:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00100000:0.0:1786175682.429522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe67800 x1872931145374720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175682.429525:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.429536:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175682.429543:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175682.429569:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145375104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175682.429584:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175682.429590:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145374720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175682.429592:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175682.429598:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175682.429610:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00080000:3.0:1786175682.429621:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.429627:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175682.429631:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175682.429636:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175682.429644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.429657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145374720:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175682.429666:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145375232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175682.429687:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175682.429693:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175682.429697:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175682.429704:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145374848:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175682.429712:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00080000:3.0:1786175682.429724:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.429733:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175682.429744:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175682.429762:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175682.429775:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145375360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175682.429787:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe66d80 x1872931145374848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175682.429797:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175682.429814:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175682.429817:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175682.429827:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145374848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175682.429827:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00080000:3.0:1786175682.429839:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.429850:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175682.429853:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175682.429868:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175682.429872:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.429882:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145374848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175682.429893:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145375488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175682.429942:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175682.429947:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1786175682.429948:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145374976:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175682.429950:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175682.429967:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00080000:3.0:1786175682.429974:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.429979:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175682.429986:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175682.430001:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175682.430007:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145375616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175682.430025:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe64700 x1872931145374976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175682.430036:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175682.430051:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175682.430054:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175682.430061:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145374976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175682.430065:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9416
00000100:00080000:3.0:1786175682.430074:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175682.430084:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175682.430086:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175682.430093:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175682.430096:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.430105:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145374976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175682.430113:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145375744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175682.430118:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145375104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175682.430159:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175682.430175:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe66300 x1872931145375104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175682.430217:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145375104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175682.430239:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175682.430243:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.430247:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145375104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175682.430254:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145375232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175682.430284:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175682.430304:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe65f80 x1872931145375232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175682.430340:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145375232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175682.430356:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175682.430362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.430368:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145375232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175682.430396:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145375360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175682.430423:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175682.430441:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe67b80 x1872931145375360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175682.430472:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145375360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175682.430488:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175682.430494:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.430500:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145375360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175682.430512:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145375488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175682.430544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175682.430558:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe65180 x1872931145375488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175682.430580:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145375488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175682.430597:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175682.430601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.430605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145375488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175682.430612:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145375616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175682.430630:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175682.430641:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe64380 x1872931145375616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175682.430664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145375616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175682.430679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175682.430685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.430691:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145375616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175682.430703:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145375744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175682.430754:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175682.430772:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175682/real 1786175682]  req@ffff89d99fe67800 x1872931145375744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175682.430788:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145375744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175682.430798:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175682.430802:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175682.430806:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145375744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175682.940991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175682.941053:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175683.453013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175683.965016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175683.965088:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175684.476973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175684.989016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175684.989066:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175685.500958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175686.013021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175686.013151:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175686.524969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175687.037070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175687.037244:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175687.548981:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175687.548990:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175687.548994:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175687.549004:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:3.0:1786175687.549014:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175687.549025:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175687.549028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786175687.549068:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145375872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175687.549088:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175687.549092:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175687.549095:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175687.549099:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:3.0:1786175687.549102:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175687.549106:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175687.549114:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175687.549125:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145375872:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175687.549127:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145376000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175687.549162:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175687.549165:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175687.549167:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175687.549174:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:3.0:1786175687.549184:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175687.549190:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175687.549196:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175687.549208:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145376128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175687.549216:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175687.549219:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175687.549220:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175687.549223:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:3.0:1786175687.549226:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175687.549230:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175687.549238:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175687.549242:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175687.549256:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145376256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175687.549266:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175687.549269:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175687.549271:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175687.549276:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:3.0:1786175687.549280:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175687.549285:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175687.549292:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175687.549314:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe66680 x1872931145375872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175687.549314:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145376384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175687.549389:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145375872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175687.549399:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175687.549403:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175687.549406:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145375872:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175687.549440:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145376000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175687.549464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175687.549469:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175687.549472:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175687.549476:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175687.549480:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe64000 x1872931145376000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175687.549484:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:3.0:1786175687.549495:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175687.549506:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175687.549510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145376000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175687.549519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175687.549521:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175687.549524:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145376000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175687.549529:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145376128:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175687.549543:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175687.549553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe67100 x1872931145376128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175687.549562:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145376128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175687.549568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175687.549570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175687.549572:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145376128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175687.549577:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145376256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175687.549593:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175687.549603:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe66a00 x1872931145376256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175687.549613:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145376256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175687.549619:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175687.549624:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175687.549625:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175687.549628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145376256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175687.549656:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145376512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175687.549668:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175687.549671:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145376384:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175687.549677:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175687.549682:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175687.549698:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175687.549730:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe65880 x1872931145376384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175687.549746:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145376384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175687.549751:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:0.0:1786175687.549767:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175687.549767:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175687.549774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175687.549783:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145376384:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175687.549784:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175687.549795:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175687.549796:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145376512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175687.549832:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145376640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175687.549842:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175687.549856:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe64a80 x1872931145376512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175687.549860:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175687.549879:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175687.549882:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175687.549888:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145376512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175687.549892:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:0.0:1786175687.549908:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175687.549914:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175687.549922:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145376512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175687.549942:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175687.549948:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175687.549954:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175687.549968:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145376768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175687.549976:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175687.549978:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175687.549981:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175687.549985:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9421
00000100:00080000:3.0:1786175687.549997:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175687.550000:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175687.550015:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175687.550031:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145376896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175687.550039:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145376640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175687.550064:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175687.550093:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe65500 x1872931145376640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175687.550102:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145376640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175687.550108:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175687.550111:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175687.550114:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145376640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175687.550119:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145376768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175687.550131:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175687.550137:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe67480 x1872931145376768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175687.550160:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145376768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175687.550166:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175687.550168:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175687.550170:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145376768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175687.550181:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145376896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175687.550196:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175687.550203:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175687/real 1786175687]  req@ffff89d99fe65880 x1872931145376896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175687.550211:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145376896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175687.550217:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175687.550219:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175687.550221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145376896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175688.061045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175688.061293:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175688.573040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175689.085057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175689.085111:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175689.597104:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175690.109032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175690.109262:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175690.621060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175691.133067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175691.133213:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175691.644987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175692.156999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175692.157235:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175692.668993:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175692.669010:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175692.669018:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175692.669036:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00080000:3.0:1786175692.669051:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175692.669056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175692.669068:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175692.669152:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145377024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175692.669188:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175692.669196:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175692.669200:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175692.669207:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00080000:3.0:1786175692.669215:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175692.669224:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175692.669240:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175692.669273:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145377152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175692.669280:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145377024:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175692.669295:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175692.669301:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175692.669305:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175692.669313:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00080000:3.0:1786175692.669319:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175692.669326:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175692.669334:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175692.669353:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145377280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175692.669369:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175692.669370:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175692.669376:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175692.669379:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175692.669386:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00080000:3.0:1786175692.669391:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175692.669397:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175692.669405:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175692.669423:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145377408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175692.669428:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe66a00 x1872931145377024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175692.669443:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175692.669449:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175692.669452:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175692.669459:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145377024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175692.669459:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00080000:3.0:1786175692.669465:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175692.669472:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175692.669479:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175692.669480:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175692.669487:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175692.669495:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145377024:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175692.669497:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145377536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175692.669513:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175692.669518:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175692.669521:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175692.669529:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00100000:0.0:1786175692.669530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145377152:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175692.669535:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175692.669542:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175692.669550:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175692.669567:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145377664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175692.669571:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175692.669587:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175692.669594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe67100 x1872931145377152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175692.669613:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175692.669617:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175692.669619:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145377152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175692.669625:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00080000:3.0:1786175692.669632:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175692.669637:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175692.669638:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175692.669643:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175692.669647:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175692.669650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145377152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175692.669661:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145377280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175692.669667:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145377792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175692.669684:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175692.669691:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:0.0:1786175692.669695:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175692.669695:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175692.669703:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00080000:3.0:1786175692.669709:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175692.669715:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175692.669716:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe64000 x1872931145377280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175692.669724:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175692.669741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145377280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175692.669743:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145377920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175692.669763:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175692.669770:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175692.669774:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175692.669774:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175692.669782:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175692.669782:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9426
00000100:00080000:3.0:1786175692.669788:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175692.669789:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145377280:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175692.669795:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175692.669800:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145377408:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786175692.669803:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175692.669820:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145378048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175692.669832:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175692.669853:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe66680 x1872931145377408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175692.669878:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145377408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175692.669928:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175692.669934:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175692.669939:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145377408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175692.669949:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145377536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175692.669980:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175692.669996:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe67800 x1872931145377536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175692.670011:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145377536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175692.670021:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175692.670025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175692.670030:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145377536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175692.670052:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145377664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175692.670072:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175692.670084:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe64380 x1872931145377664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175692.670125:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145377664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175692.670136:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175692.670139:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175692.670143:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145377664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175692.670150:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145377792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175692.670173:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175692.670186:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe65180 x1872931145377792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175692.670200:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145377792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175692.670210:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175692.670213:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175692.670216:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145377792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175692.670223:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145377920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175692.670240:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175692.670252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe67b80 x1872931145377920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175692.670266:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145377920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175692.670276:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175692.670279:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175692.670283:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145377920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175692.670289:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145378048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175692.670305:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175692.670316:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175692/real 1786175692]  req@ffff89d99fe65f80 x1872931145378048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175692.670330:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145378048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175692.670340:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175692.670343:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175692.670346:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145378048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175693.181021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175693.181251:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175693.693019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175694.205114:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175694.205216:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175694.717120:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175695.229094:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175695.229187:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175695.741050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175696.253130:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175696.253226:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175696.765019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175697.277076:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175697.277168:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175697.789062:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175697.789071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175697.789078:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175697.789086:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175697.789101:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:3.0:1786175697.789114:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175697.789126:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175697.789177:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145378176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175697.789225:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175697.789231:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175697.789234:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175697.789240:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:3.0:1786175697.789245:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175697.789254:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175697.789272:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175697.789288:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145378176:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175697.789304:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145378304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175697.789332:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175697.789340:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175697.789345:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175697.789354:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:3.0:1786175697.789363:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175697.789369:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175697.789379:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175697.789392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175697.789402:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145378432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175697.789421:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175697.789425:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175697.789428:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175697.789434:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:3.0:1786175697.789440:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175697.789446:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175697.789454:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175697.789457:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe66300 x1872931145378176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175697.789475:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145378560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175697.789492:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175697.789493:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145378176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175697.789502:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175697.789506:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175697.789511:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:3.0:1786175697.789515:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175697.789519:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175697.789530:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175697.789547:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175697.789555:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145378688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175697.789561:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175697.789577:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145378176:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175697.789584:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175697.789591:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175697.789595:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175697.789602:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:3.0:1786175697.789606:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175697.789611:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175697.789619:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175697.789620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145378304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175697.789649:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145378816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175697.789666:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175697.789674:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175697.789676:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175697.789683:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175697.789691:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:3.0:1786175697.789698:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175697.789706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe64700 x1872931145378304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175697.789711:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175697.789725:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175697.789740:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145378304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175697.789749:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145378944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175697.789769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175697.789778:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175697.789783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175697.789790:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1786175697.789797:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145378304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175697.789799:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175697.789815:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:3.0:1786175697.789821:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175697.789827:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175697.789832:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175697.789834:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145378432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175697.789856:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145379072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175697.789872:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175697.789889:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175697.789930:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe66d80 x1872931145378432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175697.789951:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145378432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175697.789965:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175697.789972:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175697.789976:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175697.789986:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9432
00000100:00080000:0.0:1786175697.789988:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175697.790003:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175697.790004:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145378432:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175697.790020:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175697.790025:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145378560:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786175697.790034:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175697.790094:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145379200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175697.790101:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175697.790130:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe65f80 x1872931145378560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175697.790150:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145378560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175697.790160:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175697.790164:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175697.790169:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145378560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175697.790177:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145378688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175697.790199:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175697.790210:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe67b80 x1872931145378688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175697.790232:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145378688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175697.790248:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175697.790254:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175697.790260:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145378688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175697.790296:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145378816:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175697.790336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175697.790355:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe65180 x1872931145378816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175697.790371:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145378816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175697.790382:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175697.790386:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175697.790390:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145378816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175697.790398:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145378944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175697.790420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175697.790431:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe64380 x1872931145378944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175697.790445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145378944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175697.790455:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175697.790458:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175697.790461:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145378944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175697.790468:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145379072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175697.790485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175697.790496:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe67800 x1872931145379072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175697.790509:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145379072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175697.790526:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175697.790530:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175697.790534:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145379072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175697.790541:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145379200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175697.790557:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175697.790567:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175697/real 1786175697]  req@ffff89d99fe66680 x1872931145379200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175697.790581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145379200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175697.790591:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175697.790594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175697.790598:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145379200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175698.301080:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175698.301164:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175698.813056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175699.325075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175699.325175:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175699.837072:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175700.349066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175700.349190:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175700.861114:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175701.372977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175701.373109:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175701.885029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175702.396978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175702.397053:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175702.909037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175702.909135:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175702.909150:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175702.909157:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175702.909173:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:1.0:1786175702.909189:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175702.909201:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175702.909249:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145379328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175702.909289:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175702.909294:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175702.909297:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175702.909302:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:1.0:1786175702.909306:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175702.909312:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175702.909324:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175702.909341:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145379456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175702.909351:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145379328:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175702.909363:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175702.909370:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175702.909372:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175702.909378:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:1.0:1786175702.909382:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175702.909387:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175702.909394:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175702.909413:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145379584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175702.909425:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175702.909430:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175702.909433:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175702.909436:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:1.0:1786175702.909440:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175702.909449:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175702.909452:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786175702.909457:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175702.909475:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145379712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175702.909487:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175702.909492:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175702.909494:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175702.909499:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:1.0:1786175702.909505:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175702.909514:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175702.909516:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2fc700 x1872931145379328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175702.909520:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175702.909540:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145379840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175702.909555:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145379328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175702.909557:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175702.909572:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175702.909579:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175702.909594:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:0.0:1786175702.909597:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175702.909599:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175702.909612:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175702.909613:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175702.909627:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175702.909632:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145379328:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175702.909644:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145379968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175702.909657:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175702.909663:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175702.909666:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175702.909670:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145379456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175702.909676:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:1.0:1786175702.909686:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175702.909692:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175702.909699:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175702.909723:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175702.909724:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145380096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175702.909744:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175702.909753:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2fdc00 x1872931145379456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175702.909754:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175702.909760:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175702.909772:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:1.0:1786175702.909780:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175702.909790:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175702.909799:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175702.909817:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145380224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175702.909826:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145379456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175702.909836:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175702.909848:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175702.909855:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175702.909864:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9437
00000100:00080000:1.0:1786175702.909875:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175702.909879:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175702.909880:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175702.909891:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175702.909953:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175702.909955:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145380352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175702.909977:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145379456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175702.910018:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145379584:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175702.910067:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175702.910087:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2fe680 x1872931145379584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175702.910104:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145379584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175702.910115:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175702.910120:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175702.910124:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145379584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175702.910132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145379712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175702.910156:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175702.910167:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2fd180 x1872931145379712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175702.910183:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145379712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175702.910192:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175702.910196:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175702.910199:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145379712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175702.910206:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145379840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175702.910226:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175702.910237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2fce00 x1872931145379840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175702.910251:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145379840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175702.910260:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175702.910264:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175702.910267:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145379840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175702.910274:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145379968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175702.910293:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175702.910303:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2fd880 x1872931145379968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175702.910316:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145379968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175702.910334:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175702.910338:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175702.910341:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145379968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175702.910367:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145380096:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175702.910387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175702.910399:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2ff480 x1872931145380096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175702.910412:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145380096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175702.910422:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175702.910426:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175702.910429:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145380096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175702.910436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145380224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175702.910454:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175702.910464:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2fc700 x1872931145380224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175702.910478:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145380224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175702.910488:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175702.910491:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175702.910496:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145380224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175702.910502:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145380352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175702.910520:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175702.910530:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175702/real 1786175702]  req@ffff89d9ba2fed80 x1872931145380352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175702.910544:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145380352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175702.910554:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175702.910557:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175702.910561:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145380352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175703.421050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175703.421184:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175703.933057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175704.445041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175704.445169:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175704.957067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175705.469067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175705.469208:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175705.981061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175706.493133:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175706.493228:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175707.005113:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175707.517045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175707.517190:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175708.029030:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175708.029043:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175708.029050:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175708.029055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175708.029066:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9442
00000100:00080000:1.0:1786175708.029081:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175708.029093:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175708.029142:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145380480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175708.029180:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175708.029185:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175708.029189:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175708.029193:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9442
00000100:00080000:1.0:1786175708.029198:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175708.029204:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175708.029216:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175708.029236:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145380608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175708.029251:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175708.029258:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145380480:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175708.029259:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175708.029266:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175708.029282:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9442
00000100:00080000:1.0:1786175708.029286:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175708.029291:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175708.029297:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175708.029313:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145380736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175708.029325:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175708.029330:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175708.029332:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175708.029336:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9442
00000100:00080000:1.0:1786175708.029353:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175708.029362:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175708.029364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786175708.029371:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175708.029403:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145380864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175708.029417:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175708.029422:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175708.029425:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175708.029429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2fdf80 x1872931145380480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175708.029435:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9442
00000100:00080000:1.0:1786175708.029445:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175708.029456:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175708.029468:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175708.029479:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145380480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175708.029487:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145380992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175708.029531:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175708.029535:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175708.029543:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175708.029550:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786175708.029558:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145380480:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175708.029561:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175708.029580:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9442
00000100:00080000:1.0:1786175708.029590:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175708.029598:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175708.029605:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145380608:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175708.029614:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175708.029645:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145381120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175708.029652:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175708.029674:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175708.029683:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2fe300 x1872931145380608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175708.029684:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175708.029691:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175708.029707:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9442
00000100:00080000:1.0:1786175708.029719:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175708.029731:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175708.029733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145380608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175708.029740:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175708.029758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175708.029766:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145381248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175708.029771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175708.029787:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145380608:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175708.029805:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175708.029813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145380736:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175708.029814:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175708.029821:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175708.029849:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9442
00000800:00000100:0.0:1786175708.029855:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175708.029859:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175708.029870:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175708.029878:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175708.029881:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2fc380 x1872931145380736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175708.029932:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145381376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175708.029971:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175708.029981:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175708.029983:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145380736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175708.029986:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175708.030004:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9442
00000100:00080000:0.0:1786175708.030012:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175708.030015:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175708.030025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175708.030028:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175708.030039:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145380736:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175708.030041:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175708.030057:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145380864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175708.030072:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145381504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175708.030097:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175708.030119:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2fd500 x1872931145380864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175708.030135:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145380864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175708.030146:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175708.030150:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175708.030154:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145380864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175708.030161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145380992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175708.030180:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175708.030191:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2fea00 x1872931145380992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175708.030205:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145380992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175708.030215:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175708.030218:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175708.030221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145380992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175708.030244:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145381120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175708.030264:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175708.030276:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2ff100 x1872931145381120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175708.030291:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145381120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175708.030301:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175708.030305:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175708.030309:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145381120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175708.030316:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145381248:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175708.030334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175708.030345:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2ffb80 x1872931145381248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175708.030359:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145381248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175708.030368:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175708.030372:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175708.030375:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145381248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175708.030381:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145381376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175708.030399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175708.030410:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2ff800 x1872931145381376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175708.030424:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145381376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175708.030433:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175708.030437:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175708.030440:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145381376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175708.030446:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145381504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175708.030462:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175708.030473:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175708/real 1786175708]  req@ffff89d9ba2fdf80 x1872931145381504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175708.030488:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145381504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175708.030497:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175708.030501:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175708.030504:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145381504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175708.541052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175708.541183:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175709.053107:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175709.565037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175709.565181:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175710.077038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175710.589079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175710.589174:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175711.101018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175711.613029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175711.613148:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175712.125030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175712.637010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175712.637127:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175713.149022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175713.149045:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175713.149055:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175713.149062:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175713.149080:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149095:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175713.149105:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175713.149152:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145381632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175713.149191:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175713.149196:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175713.149198:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175713.149203:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149207:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175713.149214:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175713.149229:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175713.149248:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145381760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175713.149264:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175713.149275:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786175713.149278:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145381632:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175713.149279:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175713.149304:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149309:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175713.149315:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175713.149322:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175713.149341:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145381888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175713.149354:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175713.149358:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175713.149361:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175713.149366:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149370:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175713.149374:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175713.149380:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175713.149394:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145382016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175713.149405:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175713.149411:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175713.149414:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175713.149418:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149423:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175713.149427:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175713.149432:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175713.149443:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175713.149455:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145382144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175713.149472:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175713.149476:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175713.149480:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175713.149488:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149492:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175713.149497:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175713.149507:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175713.149524:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145382272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175713.149533:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87c000 x1872931145381632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175713.149579:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175713.149588:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145381632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175713.149590:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175713.149599:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175713.149629:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149639:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175713.149640:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175713.149652:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175713.149661:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786175713.149676:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175713.149679:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145381632:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175713.149710:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145382400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175713.149727:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175713.149733:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175713.149736:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175713.149743:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145381760:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175713.149753:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149765:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175713.149770:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175713.149776:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175713.149789:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145382528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175713.149808:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175713.149814:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175713.149818:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175713.149825:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175713.149832:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9447
00000100:00080000:2.0:1786175713.149842:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175713.149848:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175713.149857:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175713.149859:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87c700 x1872931145381760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175713.149884:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145382656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175713.149964:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145381760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175713.149992:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175713.149999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175713.150007:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145381760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175713.150038:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145381888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175713.150088:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175713.150108:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87c380 x1872931145381888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175713.150126:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145381888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175713.150138:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175713.150142:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175713.150146:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145381888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175713.150154:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145382016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175713.150175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175713.150187:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87f800 x1872931145382016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175713.150201:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145382016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175713.150210:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175713.150214:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175713.150219:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145382016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175713.150227:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145382144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175713.150247:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175713.150258:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87df80 x1872931145382144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175713.150272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145382144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175713.150281:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175713.150285:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175713.150288:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145382144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175713.150295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145382272:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175713.150315:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175713.150330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87d500 x1872931145382272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175713.150352:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145382272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175713.150366:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175713.150373:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175713.150381:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145382272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175713.150394:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145382400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175713.150434:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175713.150452:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87ed80 x1872931145382400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175713.150468:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145382400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175713.150478:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175713.150483:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175713.150487:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145382400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175713.150517:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145382528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175713.150542:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175713.150554:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87f100 x1872931145382528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175713.150569:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145382528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175713.150580:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175713.150584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175713.150587:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145382528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175713.150595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145382656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175713.150614:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175713.150625:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175713/real 1786175713]  req@ffff89d99e87d880 x1872931145382656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175713.150639:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145382656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175713.150651:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175713.150655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175713.150659:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145382656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175713.661025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175713.661136:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175714.173026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175714.684997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175714.685114:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175715.197085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175715.709045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175715.709168:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175716.221049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175716.733004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175716.733143:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175717.245046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175717.756999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175717.757174:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175718.268985:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175718.268986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175718.268994:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175718.268999:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175718.269007:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269016:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269023:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175718.269068:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145382784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175718.269087:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175718.269091:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175718.269094:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175718.269097:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269101:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269104:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175718.269112:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175718.269124:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145382912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175718.269132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145382784:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175718.269135:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175718.269151:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175718.269154:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175718.269157:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269159:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269161:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175718.269164:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175718.269175:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145383040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175718.269186:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175718.269191:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175718.269192:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175718.269195:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269198:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269200:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175718.269204:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175718.269213:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145383168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175718.269219:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175718.269222:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175718.269223:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175718.269227:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269230:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269232:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175718.269235:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175718.269244:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175718.269250:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145383296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175718.269259:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175718.269261:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175718.269263:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175718.269266:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269271:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269274:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175718.269278:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175718.269284:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145383424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175718.269292:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175718.269295:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175718.269296:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175718.269299:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269303:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269307:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175718.269311:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175718.269312:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87dc00 x1872931145382784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175718.269325:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145383552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175718.269334:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175718.269336:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175718.269338:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175718.269345:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145382784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175718.269350:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269360:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269374:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175718.269380:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175718.269381:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.269392:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175718.269393:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145383680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175718.269409:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145382784:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175718.269432:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175718.269435:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175718.269437:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175718.269442:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9452
00000100:00080000:2.0:1786175718.269444:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175718.269446:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175718.269451:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175718.269458:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145382912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175718.269463:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145383808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175718.269531:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175718.269550:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87e680 x1872931145382912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175718.269567:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145382912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175718.269579:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.269584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175718.269589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145382912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175718.269598:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145383040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175718.269620:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175718.269631:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87ca80 x1872931145383040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175718.269645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145383040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175718.269655:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.269659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175718.269662:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145383040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175718.269669:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145383168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175718.269689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175718.269700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87d880 x1872931145383168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175718.269714:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145383168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175718.269724:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.269727:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175718.269731:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145383168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175718.269737:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145383296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175718.269757:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175718.269768:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87f100 x1872931145383296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175718.269783:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145383296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175718.269792:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.269796:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175718.269799:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145383296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175718.269806:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145383424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175718.269824:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175718.269834:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87ed80 x1872931145383424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175718.269930:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145383424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175718.269939:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.269942:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175718.269944:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145383424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175718.269970:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145383552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175718.270000:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175718.270015:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87d500 x1872931145383552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175718.270030:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145383552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175718.270040:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.270061:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175718.270064:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145383552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175718.270069:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145383680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175718.270099:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175718.270109:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87df80 x1872931145383680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175718.270125:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145383680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175718.270134:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.270137:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175718.270140:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145383680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175718.270162:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145383808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175718.270178:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175718.270187:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175718/real 1786175718]  req@ffff89d99e87f800 x1872931145383808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175718.270197:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145383808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175718.270204:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175718.270206:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175718.270210:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145383808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175718.780952:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175718.781057:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175719.293003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175719.804989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175719.805046:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175720.317011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175720.829011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175720.829144:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175721.341017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175721.853012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175721.853073:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175722.364982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175722.877024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175722.877107:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175723.389060:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389072:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175723.389077:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175723.389088:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00100000:3.0:1786175723.389091:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175723.389103:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389116:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175723.389158:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145383936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175723.389200:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389205:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175723.389208:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175723.389214:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00080000:2.0:1786175723.389220:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389225:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175723.389237:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175723.389249:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145383936:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175723.389265:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145384064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175723.389279:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389282:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175723.389283:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175723.389287:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00080000:2.0:1786175723.389290:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389293:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175723.389300:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175723.389314:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145384192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175723.389323:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389327:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175723.389330:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175723.389337:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00080000:2.0:1786175723.389341:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389344:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175723.389355:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175723.389366:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145384320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175723.389373:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389376:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175723.389379:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175723.389382:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00080000:2.0:1786175723.389387:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389391:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175723.389396:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175723.389411:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145384448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175723.389418:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389421:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175723.389424:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175723.389434:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145384064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175723.389435:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00080000:2.0:1786175723.389444:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389450:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175723.389454:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175723.389463:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145384576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175723.389472:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389474:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175723.389476:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175723.389478:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00080000:2.0:1786175723.389480:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389484:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175723.389489:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175723.389507:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145384704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175723.389529:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389533:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175723.389545:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175723.389554:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00080000:2.0:1786175723.389561:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389566:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175723.389574:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175723.389592:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145384832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175723.389605:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175723.389609:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175723.389611:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175723.389616:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9457
00000100:00080000:2.0:1786175723.389620:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175723.389622:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175723.389627:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175723.389638:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145384960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175723.390616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145384192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175723.390682:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145384320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175723.390715:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145384448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175723.390752:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145384576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175723.390783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145384704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175723.390852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145384832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175723.390883:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145384960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175723.901050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175723.901159:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175724.413066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175724.925037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175724.925132:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175725.436975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175725.949041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175725.949155:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175726.460996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:1.0:1786175726.461161:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:1.0:1786175726.461195:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1786175726.461209:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175726.461262:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:1.0:1786175726.461274:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175726.461281:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175726.461289:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175726.461297:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175726.461307:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175726.461315:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786175726.461322:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87d880 x1872931145384960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786175726.461325:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786175726.461362:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145384960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461384:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461406:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145384960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175726.461415:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87c700 x1872931145384064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175726.461442:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145384064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461451:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461454:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461458:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145384064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175726.461465:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87c000 x1872931145384192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175726.461479:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145384192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461487:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461491:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461495:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145384192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175726.461503:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87f800 x1872931145384320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175726.461516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145384320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461524:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461529:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461532:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145384320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175726.461538:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87df80 x1872931145384448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175726.461550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145384448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461557:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461560:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461564:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145384448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175726.461570:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87c380 x1872931145383936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175726.461582:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145383936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461590:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461593:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461597:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145383936:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175726.461628:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87d500 x1872931145384576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175726.461641:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145384576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461650:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145384576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175726.461664:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87ed80 x1872931145384704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175726.461678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145384704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461685:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461689:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145384704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175726.461699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175723/real 1786175726]  req@ffff89d99e87f100 x1872931145384832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175726.461712:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145384832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175726.461721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175726.461725:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175726.461728:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145384832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175726.972955:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175726.973045:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175727.484994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175727.996970:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175727.997100:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175728.509095:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175728.509096:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175728.509113:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175728.509121:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175728.509139:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00080000:3.0:1786175728.509180:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175728.509192:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175728.509258:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145385088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175728.509338:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175728.509346:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175728.509350:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175728.509358:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00080000:3.0:1786175728.509368:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175728.509377:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175728.509404:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145385088:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175728.509414:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175728.509451:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145385216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175728.509487:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175728.509494:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175728.509499:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175728.509508:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175728.509512:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00080000:3.0:1786175728.509542:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175728.509552:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175728.509565:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175728.509594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe64000 x1872931145385088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175728.509614:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145385344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175728.509631:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145385088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175728.509666:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175728.509672:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175728.509676:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175728.509683:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175728.509687:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175728.509697:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00100000:0.0:1786175728.509707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145385088:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175728.509711:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175728.509725:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175728.509737:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175728.509793:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145385216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175728.509794:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145385472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175728.509837:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175728.509844:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175728.509848:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175728.509859:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175728.509859:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00080000:3.0:1786175728.509875:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175728.509884:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175728.509894:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe67100 x1872931145385216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175728.509937:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175728.509950:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145385216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175728.509972:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175728.509972:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145385600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175728.509991:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175728.510006:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145385216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175728.510011:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175728.510023:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786175728.510024:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145385344:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175728.510029:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175728.510046:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00080000:3.0:1786175728.510056:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175728.510065:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175728.510077:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175728.510084:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175728.510109:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145385728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175728.510112:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe66a00 x1872931145385344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175728.510130:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145385344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175728.510140:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175728.510144:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175728.510148:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145385344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175728.510167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145385472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175728.510194:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175728.510210:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe65880 x1872931145385472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175728.510239:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145385472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175728.510300:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175728.510301:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175728.510318:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175728.510319:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175728.510328:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175728.510335:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145385472:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175728.510347:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00100000:0.0:1786175728.510358:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145385600:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175728.510359:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175728.510374:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175728.510385:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175728.510403:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175728.510417:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145385856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175728.510430:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe67480 x1872931145385600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175728.510446:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175728.510463:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175728.510471:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175728.510493:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00080000:3.0:1786175728.510502:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175728.510505:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145385600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175728.510517:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175728.510533:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175728.510534:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175728.510554:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175728.510561:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145385600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175728.510573:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145385984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175728.510589:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145385728:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175728.510596:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175728.510604:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175728.510609:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175728.510619:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9462
00000100:00080000:3.0:1786175728.510628:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175728.510640:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175728.510643:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175728.510655:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175728.510672:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe65500 x1872931145385728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175728.510682:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145386112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175728.510724:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145385728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175728.510737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175728.510741:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175728.510758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145385728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175728.510766:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145385856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175728.510797:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175728.510811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe64a80 x1872931145385856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175728.510824:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145385856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175728.510839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175728.510843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175728.510846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145385856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175728.510863:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145385984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175728.510886:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175728.510933:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe66a00 x1872931145385984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175728.510950:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145385984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175728.510965:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175728.510970:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175728.510974:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145385984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175728.510983:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145386112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175728.511006:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175728.511019:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175728/real 1786175728]  req@ffff89d99fe67100 x1872931145386112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175728.511031:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145386112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175728.511040:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175728.511044:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175728.511047:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145386112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175729.021048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175729.021171:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175729.533202:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175730.044999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175730.045081:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175730.556986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175731.069075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175731.069089:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175731.580986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175732.093069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175732.093233:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175732.604978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175733.117096:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175733.117182:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175733.629068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175733.629136:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175733.629146:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175733.629154:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175733.629168:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00080000:3.0:1786175733.629185:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175733.629196:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175733.629260:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145386240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175733.629301:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175733.629306:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175733.629308:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175733.629313:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00080000:3.0:1786175733.629317:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175733.629321:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175733.629337:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175733.629352:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145386368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175733.629367:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175733.629377:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145386240:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175733.629378:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175733.629393:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175733.629414:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00080000:3.0:1786175733.629418:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175733.629423:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175733.629430:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175733.629448:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145386496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175733.629459:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175733.629465:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175733.629468:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175733.629472:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00080000:3.0:1786175733.629476:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175733.629482:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175733.629488:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175733.629497:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175733.629506:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145386624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175733.629523:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175733.629530:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175733.629533:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175733.629538:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00080000:3.0:1786175733.629543:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175733.629551:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175733.629559:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175733.629583:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145386752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175733.629590:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe64000 x1872931145386240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175733.629613:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175733.629634:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175733.629643:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175733.629652:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00080000:3.0:1786175733.629659:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175733.629667:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145386240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175733.629669:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175733.629687:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175733.629729:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.629739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175733.629741:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145386880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175733.629749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145386240:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175733.629791:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175733.629796:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175733.629800:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175733.629808:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145386368:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175733.629814:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00080000:3.0:1786175733.629830:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175733.629841:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175733.629850:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175733.629867:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175733.629870:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145387008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175733.629890:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175733.629893:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe66680 x1872931145386368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175733.629947:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145386368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175733.629947:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175733.629957:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175733.629975:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.629987:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175733.629988:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00100000:0.0:1786175733.630001:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145386368:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175733.630009:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175733.630016:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145386496:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175733.630023:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175733.630045:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175733.630073:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145387136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175733.630075:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175733.630099:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175733.630101:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe67800 x1872931145386496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175733.630112:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175733.630120:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175733.630148:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9467
00000100:00080000:3.0:1786175733.630158:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175733.630165:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145386496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175733.630170:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175733.630188:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175733.630200:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.630210:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175733.630216:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145387264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175733.630225:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145386496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175733.630262:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145386624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175733.630291:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175733.630303:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe64380 x1872931145386624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175733.630316:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145386624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175733.630324:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.630327:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175733.630330:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145386624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175733.630336:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145386752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175733.630352:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175733.630361:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe65180 x1872931145386752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175733.630381:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145386752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175733.630389:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.630392:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175733.630395:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145386752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175733.630401:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145386880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175733.630417:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175733.630426:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe67b80 x1872931145386880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175733.630437:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145386880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175733.630445:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.630448:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175733.630451:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145386880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175733.630473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145387008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175733.630489:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175733.630499:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe65f80 x1872931145387008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175733.630510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145387008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175733.630525:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.630529:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175733.630532:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145387008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175733.630538:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145387136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175733.630553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175733.630562:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe66d80 x1872931145387136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175733.630574:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145387136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175733.630583:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.630586:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175733.630589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145387136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175733.630595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145387264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175733.630609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175733.630618:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175733/real 1786175733]  req@ffff89d99fe64700 x1872931145387264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175733.630630:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145387264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175733.630638:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175733.630641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175733.630645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145387264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175734.140974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175734.141037:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175734.652965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175735.164990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175735.165140:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175735.677043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175736.189025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175736.189139:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175736.701039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175737.213082:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175737.213150:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175737.725013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175738.237041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175738.237174:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175738.749045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175738.749185:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175738.749194:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175738.749199:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175738.749211:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.749224:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175738.749233:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175738.749291:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145387392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175738.749330:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175738.749334:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175738.749337:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175738.749342:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.749347:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175738.749352:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175738.749363:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175738.749381:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145387520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175738.749387:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145387392:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175738.749415:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175738.749420:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175738.749421:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175738.749428:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.749432:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175738.749437:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175738.749443:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175738.749457:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145387648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175738.749476:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175738.749480:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175738.749483:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175738.749488:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.749493:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175738.749497:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175738.749503:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175738.749505:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175738.749527:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145387776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175738.749563:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175738.749568:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175738.749571:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175738.749578:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.749584:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175738.749593:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87ca80 x1872931145387392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175738.749599:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175738.749619:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175738.749636:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145387392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175738.749638:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145387904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175738.749694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175738.749705:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175738.749710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175738.749718:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175738.749722:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175738.749725:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145387392:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175738.749737:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.749746:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175738.749751:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175738.749758:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175738.749775:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145388032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175738.749777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145387520:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175738.749810:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175738.749816:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175738.749818:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175738.749825:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.749830:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175738.749838:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175738.749848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175738.749851:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175738.749878:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145388160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175738.749879:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87e680 x1872931145387520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175738.749911:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175738.749958:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175738.749979:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175738.750003:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.750012:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175738.750019:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175738.750026:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145387520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175738.750055:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175738.750059:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175738.750065:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175738.750092:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145387520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175738.750101:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145388288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175738.750111:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145387648:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175738.750165:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175738.750170:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175738.750174:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175738.750181:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9472
00000100:00080000:2.0:1786175738.750187:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175738.750193:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175738.750204:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175738.750206:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175738.750228:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87dc00 x1872931145387648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175738.750230:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145388416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175738.750307:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145387648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175738.750317:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175738.750323:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175738.750326:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145387648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175738.750333:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145387776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175738.750353:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175738.750361:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87f100 x1872931145387776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175738.750371:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145387776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175738.750377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175738.750379:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175738.750381:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145387776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175738.750385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145387904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175738.750398:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175738.750405:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87ed80 x1872931145387904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175738.750420:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145387904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175738.750426:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175738.750428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175738.750430:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145387904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175738.750447:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145388032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175738.750460:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175738.750467:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87d500 x1872931145388032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175738.750477:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145388032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175738.750483:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175738.750485:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175738.750487:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145388032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175738.750492:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145388160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175738.750504:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175738.750511:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87c380 x1872931145388160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175738.750520:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145388160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175738.750532:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175738.750534:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175738.750537:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145388160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175738.750541:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145388288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175738.750553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175738.750559:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87df80 x1872931145388288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175738.750568:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145388288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175738.750586:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175738.750588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175738.750591:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145388288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175738.750595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145388416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175738.750607:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175738.750614:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175738/real 1786175738]  req@ffff89d99e87f800 x1872931145388416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175738.750623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145388416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175738.750629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175738.750631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175738.750634:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145388416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175739.261054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175739.261160:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175739.773061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175740.285026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175740.285110:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175740.797008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175741.309055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175741.309218:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175741.821023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175742.332977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175742.333041:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175742.844996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175743.356971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175743.357039:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175743.869012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175743.869015:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175743.869026:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175743.869031:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175743.869043:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00080000:2.0:1786175743.869077:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175743.869089:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175743.869151:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145388544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175743.869189:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175743.869194:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175743.869196:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175743.869201:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00080000:2.0:1786175743.869206:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175743.869210:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175743.869222:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175743.869251:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145388672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175743.869266:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175743.869268:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145388544:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175743.869271:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175743.869278:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175743.869285:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00080000:2.0:1786175743.869288:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175743.869292:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175743.869297:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175743.869310:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145388800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175743.869321:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175743.869325:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175743.869327:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175743.869330:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00080000:2.0:1786175743.869334:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175743.869338:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175743.869342:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175743.869354:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145388928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175743.869364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175743.869376:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175743.869381:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175743.869384:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175743.869391:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00080000:2.0:1786175743.869395:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175743.869398:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175743.869403:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175743.869414:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145389056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175743.869426:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87c000 x1872931145388544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175743.869428:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175743.869439:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175743.869444:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175743.869455:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00080000:2.0:1786175743.869461:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175743.869468:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145388544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175743.869469:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175743.869479:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175743.869515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175743.869525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175743.869527:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145389184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175743.869553:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175743.869555:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145388544:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175743.869573:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175743.869579:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175743.869589:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00100000:0.0:1786175743.869620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145388672:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175743.869629:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175743.869670:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175743.869678:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175743.869687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175743.869705:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145389312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175743.869710:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87c700 x1872931145388672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175743.869750:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175743.869754:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145388672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175743.869761:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175743.869770:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175743.869776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175743.869783:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00080000:0.0:1786175743.869787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175743.869796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145388672:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175743.869797:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175743.869809:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145388800:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175743.869811:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175743.869827:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175743.869851:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175743.869857:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145389440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175743.869889:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87d880 x1872931145388800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175743.869894:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175743.869911:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175743.869917:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175743.869980:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145388800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175743.870005:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9478
00000100:00080000:2.0:1786175743.870017:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175743.870020:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175743.870027:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175743.870035:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786175743.870040:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175743.870061:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145388800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175743.870075:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145389568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175743.870080:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145388928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175743.870142:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175743.870161:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87f800 x1872931145388928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175743.870175:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145388928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175743.870183:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175743.870186:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175743.870190:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145388928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175743.870196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145389056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175743.870215:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175743.870224:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87df80 x1872931145389056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175743.870243:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145389056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175743.870252:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175743.870255:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175743.870258:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145389056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175743.870263:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145389184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175743.870278:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175743.870287:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87c380 x1872931145389184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175743.870298:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145389184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175743.870316:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175743.870319:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175743.870322:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145389184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175743.870340:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145389312:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175743.870356:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175743.870365:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87d500 x1872931145389312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175743.870376:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145389312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175743.870383:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175743.870386:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175743.870390:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145389312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175743.870395:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145389440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175743.870410:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175743.870418:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87ed80 x1872931145389440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175743.870430:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145389440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175743.870437:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175743.870440:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175743.870443:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145389440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175743.870448:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145389568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175743.870462:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175743.870470:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175743/real 1786175743]  req@ffff89d99e87f100 x1872931145389568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175743.870482:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145389568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175743.870490:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175743.870492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175743.870495:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145389568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175744.381058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175744.381173:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175744.893136:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175745.405039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175745.405132:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175745.917066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175746.429002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175746.429111:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175746.941027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175747.453072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175747.453212:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175747.965080:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175748.477010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175748.477131:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175748.989048:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175748.989067:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175748.989075:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175748.989079:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175748.989093:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00080000:0.0:1786175748.989111:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175748.989126:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175748.989182:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145389696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175748.989225:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175748.989243:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175748.989246:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175748.989251:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00080000:0.0:1786175748.989257:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175748.989262:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175748.989275:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175748.989294:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145389824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175748.989310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145389696:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175748.989315:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175748.989325:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175748.989329:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175748.989339:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00080000:0.0:1786175748.989346:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175748.989354:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175748.989364:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175748.989390:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145389952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175748.989403:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175748.989425:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175748.989432:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175748.989436:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175748.989443:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00080000:0.0:1786175748.989450:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175748.989457:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175748.989465:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f3b80 x1872931145389696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175748.989470:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175748.989511:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145390080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175748.989517:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145389696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175748.989587:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175748.989607:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175748.989610:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175748.989617:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145389696:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175748.989620:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175748.989628:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175748.989642:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00080000:0.0:1786175748.989649:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175748.989654:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175748.989662:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175748.989668:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145389824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175748.989686:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145390208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175748.989704:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175748.989710:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175748.989717:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175748.989724:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00080000:0.0:1786175748.989730:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175748.989732:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175748.989738:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175748.989749:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175748.989791:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145390336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175748.989792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f0a80 x1872931145389824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175748.989854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145389824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175748.989855:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175748.989876:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175748.989884:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175748.989885:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175748.989896:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175748.989905:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00100000:3.0:1786175748.989906:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145389824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175748.989949:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145389952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175748.989968:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175748.989987:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175748.989987:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175748.990003:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175748.990010:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f1180 x1872931145389952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175748.990030:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145390464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175748.990033:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145389952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175748.990083:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175748.990091:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175748.990093:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175748.990096:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175748.990108:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175748.990115:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00100000:3.0:1786175748.990142:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145389952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175748.990147:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175748.990166:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175748.990168:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145390080:192.168.202.130@tcp:8:kworker.0
00000008:00100000:0.0:1786175748.990177:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175748.990220:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145390592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175748.990240:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175748.990259:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175748.990265:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175748.990268:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175748.990273:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f1880 x1872931145390080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175748.990279:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9483
00000100:00080000:0.0:1786175748.990290:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175748.990301:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175748.990307:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145390080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175748.990315:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175748.990349:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175748.990355:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175748.990363:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145390080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175748.990365:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145390720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175748.990385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145390208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175748.990412:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175748.990426:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f0e00 x1872931145390208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175748.990439:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145390208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175748.990448:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175748.990452:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175748.990455:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145390208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175748.990460:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145390336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175748.990477:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175748.990486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f3100 x1872931145390336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175748.990497:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145390336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175748.990513:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175748.990517:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175748.990520:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145390336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175748.990525:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145390464:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175748.990541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175748.990575:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f3480 x1872931145390464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175748.990590:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145390464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175748.990599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175748.990613:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175748.990616:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145390464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175748.990623:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145390592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175748.990666:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175748.990680:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f2a00 x1872931145390592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175748.990694:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145390592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175748.990704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175748.990708:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175748.990712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145390592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175748.990733:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145390720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175748.990780:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175748.990791:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175748/real 1786175748]  req@ffff89d9870f2d80 x1872931145390720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175748.990804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145390720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175773 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175748.990813:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175748.990816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175748.990819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145390720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175749.501034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175749.501097:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175750.013070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175750.525046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175750.525089:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175751.036968:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175751.549049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175751.549192:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175752.060971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175752.573038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175752.573203:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175753.084963:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175753.597054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175753.597117:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786175754.109026:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109035:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175754.109040:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175754.109042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175754.109059:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00080000:0.0:1786175754.109070:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109077:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175754.109111:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145390848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175754.109136:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109139:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175754.109141:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175754.109143:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00080000:0.0:1786175754.109145:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109148:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175754.109156:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175754.109165:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145390976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175754.109173:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109176:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175754.109177:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175754.109189:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00080000:0.0:1786175754.109194:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109201:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175754.109204:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145390848:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786175754.109208:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175754.109220:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145391104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175754.109230:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109233:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175754.109235:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175754.109237:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00080000:0.0:1786175754.109240:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109242:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175754.109245:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175754.109257:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145391232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175754.109263:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109267:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175754.109269:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175754.109283:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00080000:0.0:1786175754.109286:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109288:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175754.109292:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175754.109297:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145391360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175754.109303:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109306:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175754.109307:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175754.109310:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00080000:0.0:1786175754.109312:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109314:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175754.109317:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175754.109331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175754.109332:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145391488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175754.109348:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109352:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175754.109353:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175754.109356:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00080000:0.0:1786175754.109359:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109362:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175754.109366:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175754.109377:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145391616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175754.109385:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109389:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175754.109391:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175754.109397:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00080000:0.0:1786175754.109401:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109411:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175754.109411:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f2680 x1872931145390848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175754.109424:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175754.109448:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145391744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175754.109457:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175754.109471:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175754.109474:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175754.109481:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9488
00000100:00100000:3.0:1786175754.109482:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145390848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175754.109485:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175754.109514:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175754.109525:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175754.109540:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145391872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175754.109542:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.109559:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.109567:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145390848:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175754.109578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145390976:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175754.109608:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175754.109621:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f1500 x1872931145390976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175754.109633:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145390976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175754.109641:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.109644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.109647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145390976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175754.109674:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145391104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175754.109689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175754.109697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f0700 x1872931145391104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175754.109707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145391104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175754.109715:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.109717:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.109719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145391104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175754.109725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145391232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175754.109740:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175754.109748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f2d80 x1872931145391232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175754.109758:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145391232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175754.109765:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.109767:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.109770:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145391232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175754.109774:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145391360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175754.109787:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175754.109794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f2a00 x1872931145391360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175754.109831:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145391360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175754.109840:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.109843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.109846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145391360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175754.109852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145391488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175754.109882:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175754.109892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f3480 x1872931145391488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175754.109905:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145391488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175754.109947:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.109950:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.109954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145391488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175754.109961:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145391616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175754.109982:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175754.109994:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f3100 x1872931145391616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175754.110007:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145391616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175754.110032:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.110035:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.110038:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145391616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175754.110043:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145391744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175754.110058:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175754.110066:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f0e00 x1872931145391744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175754.110075:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145391744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175754.110089:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.110092:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.110094:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145391744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175754.110102:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145391872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175754.110126:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175754.110142:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175754/real 1786175754]  req@ffff89d9870f1880 x1872931145391872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175754.110159:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145391872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175754.110171:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175754.110176:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175754.110180:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145391872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175754.621055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175754.621167:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175755.132973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175755.645077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175755.645188:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175756.157007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175756.668992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175756.669129:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175757.181027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175757.693019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175757.693183:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175758.204996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175758.717061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175758.717260:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175759.228973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175759.228997:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175759.229004:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175759.229010:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175759.229022:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:2.0:1786175759.229032:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175759.229040:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175759.229077:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145392000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175759.229100:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175759.229103:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175759.229104:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175759.229107:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:2.0:1786175759.229110:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175759.229113:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175759.229121:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175759.229130:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145392128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175759.229139:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175759.229140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145392000:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175759.229143:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175759.229147:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175759.229155:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:2.0:1786175759.229157:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175759.229160:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175759.229163:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175759.229172:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145392256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175759.229183:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175759.229186:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175759.229187:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175759.229189:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:2.0:1786175759.229192:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175759.229194:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175759.229198:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175759.229207:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145392384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175759.229207:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175759.229216:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175759.229218:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175759.229220:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175759.229224:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:2.0:1786175759.229226:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175759.229228:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175759.229230:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175759.229238:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145392512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175759.229244:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175759.229246:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87dc00 x1872931145392000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175759.229247:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175759.229250:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175759.229257:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:2.0:1786175759.229263:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175759.229268:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175759.229272:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175759.229280:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145392640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175759.229285:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145392000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175759.229289:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175759.229297:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175759.229300:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175759.229308:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:3.0:1786175759.229310:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175759.229311:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175759.229319:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175759.229319:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786175759.229326:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175759.229327:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145392000:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175759.229334:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145392768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175759.229351:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175759.229351:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145392128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175759.229357:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175759.229360:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175759.229363:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:2.0:1786175759.229366:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175759.229369:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175759.229372:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175759.229379:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175759.229387:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145392896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175759.229393:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87e680 x1872931145392128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175759.229415:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175759.229418:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786175759.229421:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145392128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175759.229422:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175759.229434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175759.229435:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9493
00000100:00080000:3.0:1786175759.229440:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175759.229443:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175759.229444:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145392128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175759.229464:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175759.229468:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145392256:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175759.229471:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175759.229485:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145393024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175759.229493:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175759.229505:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87ca80 x1872931145392256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175759.229520:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145392256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175759.229526:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175759.229528:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175759.229530:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145392256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175759.229534:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145392384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175759.229546:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175759.229560:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87f100 x1872931145392384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175759.229578:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145392384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175759.229584:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175759.229587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175759.229590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145392384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175759.229595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145392512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175759.229612:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175759.229620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87ed80 x1872931145392512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175759.229634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145392512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175759.229649:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175759.229652:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175759.229657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145392512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175759.229666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145392640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175759.229696:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175759.229709:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87d500 x1872931145392640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175759.229722:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145392640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175759.229729:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175759.229733:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175759.229737:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145392640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175759.229772:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145392768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175759.229862:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175759.229878:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87c380 x1872931145392768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175759.229895:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145392768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175759.230028:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175759.230033:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175759.230039:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145392768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175759.230047:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145392896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175759.230115:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175759.230126:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87df80 x1872931145392896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175759.230135:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145392896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175759.230141:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175759.230143:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175759.230145:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145392896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175759.230149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145393024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175759.230163:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175759.230169:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175759/real 1786175759]  req@ffff89d99e87f800 x1872931145393024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175759.230177:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145393024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175759.230182:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175759.230183:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175759.230185:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145393024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175759.741051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175759.741183:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175760.253031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175760.765023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175760.765109:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175761.276970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175761.789065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175761.789195:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175762.301056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175762.813047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175762.813182:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175763.325084:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175763.837081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175763.837134:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175764.349038:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175764.349052:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175764.349059:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175764.349072:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349087:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175764.349095:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175764.349103:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175764.349170:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145393152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175764.349222:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175764.349230:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175764.349234:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175764.349242:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349249:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175764.349257:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175764.349271:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175764.349295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145393152:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175764.349296:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145393280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175764.349331:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175764.349337:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175764.349341:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175764.349349:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349356:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175764.349363:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175764.349375:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175764.349437:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145393408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175764.349454:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175764.349470:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175764.349478:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175764.349482:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175764.349489:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349496:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175764.349502:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175764.349512:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175764.349530:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145393536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175764.349543:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87d880 x1872931145393152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175764.349549:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175764.349559:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175764.349566:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175764.349582:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349592:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175764.349599:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175764.349605:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175764.349615:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145393152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175764.349620:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145393664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175764.349676:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175764.349680:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175764.349682:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175764.349688:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175764.349695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175764.349699:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349705:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175764.349708:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145393152:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175764.349714:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175764.349727:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175764.349740:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145393792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175764.349760:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175764.349765:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175764.349769:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175764.349773:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145393280:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175764.349788:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349794:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175764.349799:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175764.349806:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175764.349824:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145393920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175764.349838:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175764.349840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175764.349844:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175764.349849:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175764.349857:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349864:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175764.349869:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175764.349875:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175764.349883:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87c700 x1872931145393280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175764.349928:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145394048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175764.349945:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175764.349952:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175764.349956:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175764.349962:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145393280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175764.349969:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9498
00000100:00080000:2.0:1786175764.349980:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175764.349990:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175764.349991:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175764.349997:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175764.350002:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175764.350011:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145393280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175764.350019:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145394176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175764.350028:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145393408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175764.350073:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175764.350090:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87c000 x1872931145393408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175764.350105:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145393408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175764.350115:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175764.350118:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175764.350122:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145393408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175764.350129:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145393536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175764.350148:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175764.350160:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87f800 x1872931145393536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175764.350174:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145393536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175764.350183:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175764.350186:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175764.350190:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145393536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175764.350196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145393664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175764.350215:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175764.350226:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87df80 x1872931145393664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175764.350240:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145393664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175764.350249:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175764.350252:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175764.350256:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145393664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175764.350262:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145393792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175764.350280:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175764.350290:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87c380 x1872931145393792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175764.350304:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145393792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175764.350314:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175764.350317:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175764.350320:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145393792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175764.350351:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145393920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175764.350370:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175764.350382:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87d500 x1872931145393920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175764.350442:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145393920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175764.350453:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175764.350457:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175764.350461:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145393920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175764.350469:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145394048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175764.350497:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175764.350510:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87ed80 x1872931145394048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175764.350524:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145394048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175764.350534:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175764.350537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175764.350541:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145394048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175764.350548:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145394176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175764.350566:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175764.350576:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175764/real 1786175764]  req@ffff89d99e87f100 x1872931145394176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175764.350590:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145394176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175764.350600:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175764.350603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175764.350607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145394176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175764.861091:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175764.861261:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175765.373145:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175765.885090:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175765.885370:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175766.397108:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175766.909015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175766.909084:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175767.421031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175767.933107:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175767.933173:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175768.445124:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175768.957042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175768.957214:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175769.469060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175769.469089:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175769.469101:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175769.469108:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175769.469125:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9503
00000100:00080000:0.0:1786175769.469139:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175769.469164:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175769.469224:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145394304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175769.469264:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175769.469270:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175769.469273:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175769.469278:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9503
00000100:00080000:0.0:1786175769.469283:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175769.469289:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175769.469303:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175769.469326:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145394304:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175769.469327:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145394432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175769.469383:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175769.469388:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175769.469392:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175769.469399:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9503
00000100:00080000:0.0:1786175769.469405:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175769.469411:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175769.469421:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175769.469443:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145394560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175769.469457:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175769.469462:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175769.469464:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175769.469468:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9503
00000100:00080000:0.0:1786175769.469474:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175769.469481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175769.469488:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175769.469497:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175769.469517:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145394688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175769.469529:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175769.469534:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175769.469537:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175769.469543:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9503
00000100:00080000:0.0:1786175769.469549:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175769.469557:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f1180 x1872931145394304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175769.469558:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175769.469571:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175769.469598:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145394816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175769.469604:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145394304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175769.469642:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175769.469650:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175769.469651:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175769.469662:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175769.469664:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175769.469674:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145394304:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175769.469695:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9503
00000100:00080000:0.0:1786175769.469706:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175769.469711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145394432:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175769.469723:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175769.469737:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786175769.469751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175769.469774:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145394944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175769.469775:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f0a80 x1872931145394432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175769.469844:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145394432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175769.469850:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175769.469877:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175769.469879:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175769.469887:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175769.469888:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175769.469933:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145394432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175769.469944:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145394560:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175769.469971:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9503
00000800:00000100:3.0:1786175769.469978:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175769.469986:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175769.469998:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175769.470003:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f3b80 x1872931145394560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175769.470011:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175769.470031:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145394560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175769.470045:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175769.470047:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145395072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175769.470057:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175769.470071:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145394560:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175769.470088:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175769.470092:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145394688:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175769.470101:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175769.470106:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175769.470115:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9503
00000100:00080000:0.0:1786175769.470122:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175769.470131:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175769.470138:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175769.470145:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175769.470160:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f1880 x1872931145394688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175769.470169:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145395200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175769.470191:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145394688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175769.470194:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175769.470211:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175769.470218:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175769.470227:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175769.470234:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9503
00000100:00080000:3.0:1786175769.470241:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175769.470243:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175769.470251:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145394688:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175769.470258:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175769.470269:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175769.470270:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145394816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175769.470293:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145395328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175769.470306:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175769.470330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f0e00 x1872931145394816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175769.470371:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145394816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175769.470383:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175769.470389:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175769.470395:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145394816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175769.470442:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145394944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175769.470470:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175769.470484:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f3100 x1872931145394944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175769.470499:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145394944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175769.470510:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175769.470513:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175769.470517:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145394944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175769.470524:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145395072:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175769.470542:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175769.470554:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f3480 x1872931145395072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175769.470569:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145395072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175769.470578:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175769.470582:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175769.470585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145395072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175769.470591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145395200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175769.470609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175769.470620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f2a00 x1872931145395200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175769.470634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145395200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175769.470644:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175769.470647:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175769.470650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145395200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175769.470657:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145395328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175769.470674:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175769.470684:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175769/real 1786175769]  req@ffff89d9870f2d80 x1872931145395328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175769.470697:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145395328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175769.470708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175769.470711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175769.470715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145395328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175769.980981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175769.981200:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175770.493056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175771.005054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175771.005179:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175771.517081:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175772.029044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175772.029187:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175772.541021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175773.053040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175773.053182:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175773.565029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175774.077051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175774.077122:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175774.589002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175774.589110:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.589128:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175774.589137:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175774.589156:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9508
00000100:00080000:1.0:1786175774.589175:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175774.589190:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175774.589267:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145395456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175774.589368:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.589380:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786175774.589381:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145395456:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175774.589384:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175774.589399:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9508
00000100:00080000:1.0:1786175774.589407:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175774.589415:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175774.589432:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175774.589454:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145395584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175774.589479:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.589484:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175774.589486:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175774.589495:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9508
00000800:00000100:3.0:1786175774.589505:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175774.589509:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175774.589517:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175774.589525:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175774.589539:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145395712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175774.589553:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.589557:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175774.589561:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175774.589568:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9508
00000100:00080000:1.0:1786175774.589574:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175774.589581:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175774.589585:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2fed80 x1872931145395456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175774.589588:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175774.589614:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145395840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175774.589625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145395456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175774.589642:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.589663:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175774.589666:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175774.589668:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175774.589675:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9508
00000100:00080000:3.0:1786175774.589680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175774.589682:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175774.589693:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175774.589716:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175774.589716:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145395456:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175774.589731:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145395968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175774.589745:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.589751:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175774.589754:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175774.589765:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9508
00000100:00080000:1.0:1786175774.589782:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175774.589782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145395584:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175774.589798:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175774.589810:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175774.589829:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145396096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175774.589854:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.589860:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175774.589862:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175774.589872:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9508
00000800:00000100:3.0:1786175774.589873:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175774.589878:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175774.589884:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175774.589891:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175774.589906:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2fc700 x1872931145395584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175774.589930:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145395584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175774.589960:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145396224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175774.589973:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.589978:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175774.589981:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175774.589988:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9508
00000100:00080000:3.0:1786175774.589995:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175774.589996:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175774.590011:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175774.590014:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786175774.590022:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175774.590030:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145395584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175774.590038:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145396352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175774.590048:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145395712:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175774.590088:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175774.590092:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175774.590095:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175774.590097:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175774.590118:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9508
00000100:00100000:3.0:1786175774.590127:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2ff480 x1872931145395712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175774.590132:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175774.590143:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145395712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175774.590150:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786175774.590165:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175774.590172:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786175774.590174:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175774.590176:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145395712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175774.590192:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145395840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175774.590216:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145396480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786175774.590217:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175774.590237:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2fd880 x1872931145395840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175774.590257:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145395840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175774.590264:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175774.590267:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175774.590271:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145395840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175774.590280:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145395968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175774.590294:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175774.590317:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2fce00 x1872931145395968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175774.590346:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145395968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175774.590355:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175774.590359:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175774.590362:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145395968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175774.590385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145396096:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175774.590427:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175774.590440:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2fd180 x1872931145396096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175774.590453:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145396096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175774.590462:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175774.590465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175774.590469:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145396096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175774.590477:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145396224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175774.590499:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175774.590512:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2fe680 x1872931145396224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175774.590524:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145396224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175774.590533:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175774.590537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175774.590540:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145396224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175774.590548:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145396352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175774.590569:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175774.590582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2fdc00 x1872931145396352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175774.590594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145396352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175774.590603:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175774.590606:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175774.590610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145396352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175774.590616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145396480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175774.590636:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175774.590649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175774/real 1786175774]  req@ffff89d9ba2fed80 x1872931145396480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175774.590660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145396480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175774.590670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175774.590674:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175774.590678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145396480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175775.101057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175775.101219:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175775.613050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175776.125086:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175776.125247:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175776.636994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175777.149013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175777.149183:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175777.661036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175778.173004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175778.173117:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175778.685051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175779.197012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175779.197059:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175779.708984:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175779.708985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175779.708994:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175779.708999:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175779.709010:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709021:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175779.709031:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175779.709070:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145396608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175779.709092:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175779.709095:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175779.709097:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175779.709100:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709104:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175779.709108:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175779.709116:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175779.709123:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145396608:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175779.709130:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145396736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175779.709139:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175779.709141:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175779.709143:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175779.709146:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709148:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175779.709151:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175779.709154:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175779.709172:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145396864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175779.709180:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175779.709183:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175779.709185:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175779.709188:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175779.709192:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709196:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175779.709199:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175779.709203:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175779.709212:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145396992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175779.709219:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175779.709222:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175779.709225:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175779.709226:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe66300 x1872931145396608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175779.709230:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709235:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175779.709242:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175779.709246:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175779.709264:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145396608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175779.709270:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145397120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175779.709281:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175779.709283:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175779.709287:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175779.709289:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175779.709290:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175779.709298:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145396608:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175779.709299:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709306:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175779.709311:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175779.709314:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175779.709321:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145397248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175779.709345:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145396736:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175779.709349:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175779.709354:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175779.709356:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175779.709361:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709366:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175779.709370:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175779.709375:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175779.709379:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175779.709393:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145397376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175779.709401:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe64700 x1872931145396736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175779.709409:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175779.709418:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175779.709422:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175779.709431:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709435:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175779.709436:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145396736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175779.709444:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175779.709453:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175779.709457:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175779.709465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175779.709466:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145397504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175779.709472:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145396736:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175779.709489:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175779.709492:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145396864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175779.709494:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175779.709499:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175779.709505:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9513
00000100:00080000:3.0:1786175779.709508:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175779.709511:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175779.709516:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175779.709521:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175779.709531:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145397632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175779.709537:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe66d80 x1872931145396864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175779.709581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145396864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175779.709588:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175779.709591:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175779.709594:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145396864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175779.709599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145396992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175779.709615:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175779.709622:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe65f80 x1872931145396992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175779.709629:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145396992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175779.709634:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175779.709636:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175779.709638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145396992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175779.709641:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145397120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175779.709652:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175779.709657:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe67b80 x1872931145397120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175779.709665:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145397120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175779.709670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175779.709671:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175779.709673:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145397120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175779.709684:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145397248:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175779.709694:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175779.709700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe65180 x1872931145397248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175779.709707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145397248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175779.709713:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175779.709715:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175779.709717:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145397248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175779.709720:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145397376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175779.709729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175779.709735:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe64380 x1872931145397376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175779.709741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145397376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175779.709747:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175779.709748:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175779.709750:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145397376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175779.709753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145397504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175779.709762:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175779.709767:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe67800 x1872931145397504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175779.709774:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145397504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175779.709778:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175779.709780:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175779.709782:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145397504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175779.709785:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145397632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175779.709794:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175779.709800:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175779/real 1786175779]  req@ffff89d99fe66680 x1872931145397632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175779.709806:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145397632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175779.709811:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175779.709813:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175779.709816:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145397632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175780.220977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175780.221096:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175780.733099:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175781.244964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175781.245046:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175781.756969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175782.269033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175782.269192:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175782.781020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175783.292992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175783.293051:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175783.805069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175784.316997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175784.317085:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175784.829103:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175784.829107:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175784.829115:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175784.829119:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175784.829128:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829136:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175784.829144:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175784.829180:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145397760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175784.829221:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175784.829225:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175784.829227:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175784.829232:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829253:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175784.829258:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175784.829269:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145397760:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786175784.829270:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175784.829294:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145397888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175784.829307:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175784.829311:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175784.829313:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175784.829317:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829336:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175784.829340:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175784.829345:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175784.829346:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175784.829365:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145398016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175784.829380:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175784.829385:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175784.829389:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175784.829400:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2fdf80 x1872931145397760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175784.829400:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829414:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175784.829424:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175784.829429:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145397760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175784.829438:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175784.829443:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.829449:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.829454:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145397760:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175784.829463:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145398144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175784.829475:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175784.829479:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175784.829484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145397888:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175784.829484:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175784.829495:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829501:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175784.829505:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175784.829512:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175784.829530:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145398272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175784.829531:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175784.829565:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175784.829570:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175784.829575:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175784.829576:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2ff800 x1872931145397888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175784.829585:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829595:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175784.829604:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145397888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175784.829605:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175784.829618:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175784.829619:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.829628:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.829634:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145397888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175784.829637:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145398400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175784.829650:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145398016:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175784.829651:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175784.829659:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175784.829663:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175784.829666:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829670:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175784.829673:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175784.829677:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175784.829686:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145398528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175784.829693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175784.829702:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175784.829705:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175784.829707:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175784.829711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2ffb80 x1872931145398016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175784.829712:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829718:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175784.829726:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175784.829732:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175784.829736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145398016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175784.829745:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145398656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175784.829746:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.829754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.829762:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145398016:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175784.829770:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175784.829775:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145398144:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175784.829775:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175784.829780:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175784.829786:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9519
00000100:00080000:1.0:1786175784.829789:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175784.829792:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175784.829797:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175784.829802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175784.829810:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145398784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175784.829820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2ff100 x1872931145398144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175784.829838:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145398144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175784.829850:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.829854:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.829858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145398144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175784.829874:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145398272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175784.829892:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175784.829900:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2fea00 x1872931145398272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175784.829909:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145398272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175784.829915:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.829918:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.829920:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145398272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175784.829924:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145398400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175784.829958:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175784.829966:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2fd500 x1872931145398400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175784.829974:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145398400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175784.829980:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.829982:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.829985:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145398400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175784.829989:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145398528:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175784.830000:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175784.830007:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2fc380 x1872931145398528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175784.830015:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145398528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175784.830021:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.830022:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.830024:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145398528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175784.830028:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145398656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175784.830038:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175784.830044:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2fe300 x1872931145398656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175784.830053:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145398656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175784.830059:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.830060:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.830062:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145398656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175784.830066:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145398784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175784.830076:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175784.830082:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175784/real 1786175784]  req@ffff89d9ba2fdf80 x1872931145398784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175784.830091:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145398784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175784.830096:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175784.830098:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175784.830100:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145398784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175785.340984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175785.341066:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175785.853044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175786.365040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175786.365154:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175786.877040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175787.389056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175787.389150:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175787.901039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175788.412992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175788.413155:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175788.925025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175789.437047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175789.437180:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175789.948997:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949008:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175789.949014:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175789.949017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175789.949027:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00080000:1.0:1786175789.949040:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175789.949049:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175789.949092:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145398912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175789.949123:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949128:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175789.949130:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175789.949134:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00080000:1.0:1786175789.949137:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175789.949141:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175789.949187:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175789.949191:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145398912:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175789.949208:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145399040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175789.949222:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949226:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175789.949228:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175789.949233:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00080000:1.0:1786175789.949238:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175789.949242:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175789.949248:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175789.949261:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145399168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175789.949271:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949275:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175789.949276:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175789.949279:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00080000:1.0:1786175789.949284:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175789.949287:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175789.949291:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175789.949301:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145399296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175789.949327:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949331:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175789.949338:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175789.949343:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00080000:1.0:1786175789.949348:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175789.949353:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145399040:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175789.949357:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175789.949369:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175789.949385:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145399424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175789.949398:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949402:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175789.949405:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175789.949414:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00100000:0.0:1786175789.949415:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145399168:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175789.949419:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175789.949425:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175789.949431:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175789.949447:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145399552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175789.949457:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145399296:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175789.949461:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949472:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175789.949475:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175789.949480:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00080000:1.0:1786175789.949484:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175789.949487:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175789.949493:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175789.949507:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145399680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175789.949517:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949521:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175789.949523:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175789.949528:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145399424:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175789.949531:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00080000:1.0:1786175789.949543:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175789.949550:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175789.949555:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175789.949570:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145399808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175789.949582:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145399552:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175789.949583:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175789.949594:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175789.949596:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175789.949601:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9524
00000100:00080000:1.0:1786175789.949608:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175789.949614:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175789.949616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145399680:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175789.949629:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175789.949651:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145399808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175789.949660:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145399936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175789.949699:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145399936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175790.461033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175790.461219:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175790.973019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175791.485034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175791.485203:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175791.997026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175792.509029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175792.509226:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175793.021028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786175793.021298:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786175793.021350:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786175793.021369:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175793.021429:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786175793.021444:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175793.021454:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175793.021464:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175793.021472:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175793.021484:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175793.021495:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175793.021507:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175793.021541:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2fdf80 x1872931145399936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.021578:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145399936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.021595:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.021601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.021607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145399936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175793.021617:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2fc700 x1872931145399808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.021631:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145399808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.021641:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.021645:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.021649:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145399808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175793.021656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2fce00 x1872931145399424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.021671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145399424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.021684:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.021691:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.021698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145399424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175793.021711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2fd880 x1872931145399552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.021750:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145399552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.021767:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.021772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.021778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145399552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175793.021789:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2ff480 x1872931145399680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.021813:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145399680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.021828:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.021833:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.021840:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145399680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175793.021852:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2fdc00 x1872931145399040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.021875:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145399040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.021889:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.021895:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.021944:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145399040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175793.021960:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2fe680 x1872931145399168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.021991:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145399168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.022011:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.022020:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.022027:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145399168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175793.022042:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2fd180 x1872931145399296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.022066:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145399296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.022083:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.022090:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.022096:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145399296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175793.022108:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175789/real 1786175793]  req@ffff89d9ba2fed80 x1872931145398912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175793.022167:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145398912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175793.022184:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175793.022190:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175793.022197:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145398912:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175793.533059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175793.533191:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175794.045034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175794.557028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175794.557255:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175795.069094:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175795.069131:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175795.069139:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175795.069155:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00080000:3.0:1786175795.069169:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175795.069180:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175795.069223:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786175795.069230:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145400064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175795.069269:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175795.069275:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175795.069279:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175795.069286:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00080000:3.0:1786175795.069291:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175795.069298:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175795.069310:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175795.069330:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145400192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175795.069361:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175795.069366:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175795.069368:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175795.069374:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00080000:3.0:1786175795.069379:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175795.069383:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175795.069391:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175795.069406:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145400320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175795.069424:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175795.069432:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175795.069436:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175795.069444:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00100000:0.0:1786175795.069454:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145400064:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175795.069458:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175795.069479:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175795.069492:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175795.069526:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145400448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175795.069554:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175795.069566:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175795.069568:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175795.069578:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175795.069605:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00080000:3.0:1786175795.069616:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175795.069626:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175795.069637:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175795.069641:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe64000 x1872931145400064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175795.069672:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145400576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175795.069688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145400064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175795.069705:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175795.069723:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175795.069726:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175795.069729:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175795.069747:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00080000:0.0:1786175795.069756:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175795.069761:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175795.069773:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145400064:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175795.069782:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175795.069799:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175795.069803:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145400192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175795.069832:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145400704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175795.069855:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175795.069866:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000800:00000100:0.0:1786175795.069868:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175795.069874:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175795.069890:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00100000:0.0:1786175795.069951:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe67100 x1872931145400192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175795.069953:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175795.069973:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175795.069994:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175795.070006:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145400192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175795.070025:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145400832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175795.070032:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175795.070052:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175795.070067:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175795.070069:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145400192:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175795.070083:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175795.070091:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175795.070097:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145400320:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175795.070142:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00080000:3.0:1786175795.070152:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175795.070159:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175795.070168:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175795.070185:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175795.070193:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145400960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175795.070212:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe66a00 x1872931145400320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175795.070231:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175795.070241:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175795.070245:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175795.070247:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145400320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175795.070256:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9529
00000100:00080000:3.0:1786175795.070271:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175795.070286:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175795.070290:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786175795.070299:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175795.070301:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175795.070312:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145400320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175795.070329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145401088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175795.070376:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145400448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175795.070433:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175795.070451:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe64a80 x1872931145400448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175795.070469:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145400448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175795.070480:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175795.070485:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175795.070489:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145400448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175795.070498:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145400576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175795.070527:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175795.070544:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe65500 x1872931145400576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175795.070563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145400576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175795.070577:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175795.070584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175795.070591:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145400576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175795.070602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145400704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175795.070634:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175795.070651:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe67480 x1872931145400704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175795.070670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145400704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175795.070681:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175795.070685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175795.070690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145400704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175795.070698:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145400832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175795.070726:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175795.070744:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe65880 x1872931145400832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175795.070763:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145400832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175795.070776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175795.070780:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175795.070785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145400832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175795.070795:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145400960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175795.070825:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175795.070845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe66680 x1872931145400960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175795.070863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145400960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175795.070875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175795.070879:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175795.070884:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145400960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175795.070892:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145401088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175795.070921:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175795.070986:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175795/real 1786175795]  req@ffff89d99fe67800 x1872931145401088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175795.071008:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145401088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175795.071022:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175795.071028:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175795.071033:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145401088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175795.581018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175795.581077:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175796.093012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175796.605033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175796.605284:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175797.117046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175797.629017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175797.629229:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175798.141066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175798.653017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175798.653219:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175799.165053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175799.677123:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175799.677172:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175800.188966:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175800.188966:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175800.188975:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175800.188979:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175800.188988:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9534
00000100:00080000:3.0:1786175800.188996:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175800.189003:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175800.189047:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145401216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175800.189084:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175800.189087:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175800.189089:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175800.189092:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9534
00000100:00080000:3.0:1786175800.189096:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175800.189099:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175800.189108:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175800.189117:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145401216:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175800.189121:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145401344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175800.189130:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175800.189133:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175800.189134:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175800.189137:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9534
00000100:00080000:3.0:1786175800.189140:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175800.189142:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175800.189144:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175800.189153:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145401472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175800.189159:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175800.189162:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175800.189163:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175800.189166:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9534
00000100:00080000:3.0:1786175800.189168:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175800.189171:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175800.189177:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175800.189180:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175800.189193:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145401600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175800.189200:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175800.189202:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175800.189204:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175800.189207:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9534
00000100:00080000:3.0:1786175800.189210:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175800.189212:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175800.189215:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175800.189225:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145401728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175800.189231:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe64380 x1872931145401216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175800.189243:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175800.189248:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175800.189250:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175800.189254:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145401216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175800.189261:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9534
00000100:00080000:0.0:1786175800.189267:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175800.189269:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175800.189274:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175800.189279:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175800.189280:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145401216:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175800.189289:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175800.189302:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145401856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175800.189306:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145401344:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175800.189318:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175800.189321:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175800.189323:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175800.189327:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9534
00000800:00000100:0.0:1786175800.189332:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175800.189332:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175800.189339:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175800.189343:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175800.189348:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe65180 x1872931145401344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175800.189353:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145401984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175800.189367:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175800.189368:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145401344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175800.189372:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175800.189375:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175800.189383:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9534
00000100:00080000:0.0:1786175800.189385:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175800.189386:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175800.189392:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175800.189393:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175800.189401:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175800.189402:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145401344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175800.189412:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145401472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175800.189414:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145402112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175800.189423:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175800.189425:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175800.189426:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175800.189431:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175800.189432:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9534
00000100:00080000:3.0:1786175800.189439:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175800.189442:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175800.189445:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175800.189447:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe67b80 x1872931145401472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175800.189456:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145402240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175800.189470:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145401472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175800.189478:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175800.189481:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175800.189484:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145401472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175800.189490:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145401600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175800.189508:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175800.189514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe65f80 x1872931145401600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175800.189522:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145401600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175800.189527:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175800.189528:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175800.189530:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145401600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175800.189534:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145401728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175800.189543:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175800.189548:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe66d80 x1872931145401728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175800.189555:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145401728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175800.189560:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175800.189562:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175800.189564:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145401728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175800.189574:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145401856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175800.189584:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175800.189590:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe64700 x1872931145401856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175800.189598:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145401856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175800.189603:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175800.189604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175800.189606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145401856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175800.189609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145401984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175800.189619:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175800.189625:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe66300 x1872931145401984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175800.189632:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145401984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175800.189637:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175800.189639:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175800.189640:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145401984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175800.189644:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145402112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175800.189653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175800.189658:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe64380 x1872931145402112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175800.189664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145402112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175800.189674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175800.189676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175800.189678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145402112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175800.189681:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145402240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175800.189689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175800.189694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175800/real 1786175800]  req@ffff89d99fe67800 x1872931145402240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175800.189702:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145402240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175800.189707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175800.189709:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175800.189711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145402240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175800.701035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175800.701124:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175801.212966:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175801.725088:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175801.725182:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175802.237157:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175802.749079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175802.749249:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175803.260988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175803.772981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175803.773083:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175804.285035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175804.797088:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175804.797228:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175805.309048:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175805.309048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175805.309060:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175805.309065:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175805.309077:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00080000:1.0:1786175805.309089:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175805.309098:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175805.309147:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145402368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175805.309175:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175805.309179:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175805.309182:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175805.309187:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00080000:1.0:1786175805.309191:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175805.309197:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175805.309212:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175805.309213:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145402368:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175805.309234:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145402496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175805.309245:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175805.309248:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175805.309250:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175805.309253:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00080000:1.0:1786175805.309267:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175805.309270:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175805.309275:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175805.309286:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145402624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175805.309293:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175805.309296:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175805.309298:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175805.309301:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00080000:1.0:1786175805.309303:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175805.309306:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175805.309309:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175805.309314:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175805.309319:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145402752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175805.309328:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175805.309331:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175805.309333:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175805.309338:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00080000:1.0:1786175805.309341:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175805.309344:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175805.309348:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175805.309356:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145402880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175805.309363:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175805.309366:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786175805.309370:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2fe300 x1872931145402368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175805.309370:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175805.309379:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00080000:1.0:1786175805.309386:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175805.309390:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175805.309394:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175805.309398:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145402368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175805.309406:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145403008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175805.309413:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175805.309418:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175805.309423:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175805.309424:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145402368:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175805.309432:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175805.309436:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175805.309440:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00080000:1.0:1786175805.309443:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175805.309446:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175805.309450:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175805.309459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145402496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175805.309467:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145403136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175805.309481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175805.309483:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175805.309488:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175805.309491:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175805.309495:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2fc380 x1872931145402496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175805.309501:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00080000:1.0:1786175805.309510:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175805.309511:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145402496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175805.309517:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175805.309523:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786175805.309526:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175805.309528:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175805.309533:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145402496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175805.309539:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145402624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175805.309544:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145403264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175805.309554:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175805.309559:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175805.309561:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175805.309564:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175805.309569:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9539
00000100:00100000:0.0:1786175805.309572:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2fd500 x1872931145402624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175805.309574:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175805.309583:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175805.309589:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145402624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175805.309589:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175805.309602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175805.309604:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145403392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175805.309608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175805.309615:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145402624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175805.309626:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145402752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175805.309643:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175805.309650:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2fea00 x1872931145402752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175805.309658:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145402752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175805.309664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175805.309665:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175805.309667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145402752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175805.309671:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145402880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175805.309683:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175805.309689:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2ff100 x1872931145402880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175805.309697:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145402880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175805.309702:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175805.309704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175805.309706:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145402880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175805.309709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145403008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175805.309721:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175805.309727:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2ffb80 x1872931145403008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175805.309736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145403008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175805.309741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175805.309743:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175805.309745:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145403008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175805.309760:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145403136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175805.309782:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175805.309789:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2ff800 x1872931145403136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175805.309797:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145403136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175805.309803:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175805.309805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175805.309807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145403136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175805.309811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145403264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175805.309821:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175805.309827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2fe300 x1872931145403264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175805.309835:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145403264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175805.309847:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175805.309849:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175805.309851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145403264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175805.309854:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145403392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175805.309881:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175805.309891:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175805/real 1786175805]  req@ffff89d9ba2fed80 x1872931145403392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175805.309902:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145403392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175805.309937:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175805.309941:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175805.309945:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145403392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175805.821091:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175805.821195:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175806.333099:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175806.845028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175806.845160:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175807.357084:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175807.869048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175807.869273:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175808.381005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175808.893027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175808.893094:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175809.405025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175809.917051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175809.917139:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175810.429067:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175810.429068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175810.429080:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175810.429086:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175810.429097:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00080000:1.0:1786175810.429109:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175810.429118:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175810.429159:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145403520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175810.429190:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175810.429194:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175810.429196:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175810.429199:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00080000:1.0:1786175810.429203:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175810.429206:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175810.429216:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175810.429229:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145403648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175810.429241:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145403520:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175810.429245:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175810.429254:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175810.429256:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175810.429261:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00080000:1.0:1786175810.429264:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175810.429268:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175810.429273:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175810.429286:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145403776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175810.429296:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175810.429300:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175810.429302:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175810.429306:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00080000:1.0:1786175810.429310:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175810.429313:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175810.429318:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175810.429322:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175810.429333:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145403904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175810.429345:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175810.429349:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175810.429350:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175810.429354:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00080000:1.0:1786175810.429357:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175810.429361:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175810.429366:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175810.429373:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2fd180 x1872931145403520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175810.429379:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145404032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175810.429419:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175810.429423:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175810.429425:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175810.429430:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145403520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175810.429434:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00080000:1.0:1786175810.429441:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175810.429450:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175810.429460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786175810.429461:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175810.429473:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175810.429479:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145404160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175810.429484:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145403520:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175810.429504:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175810.429508:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175810.429510:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175810.429514:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00080000:1.0:1786175810.429518:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175810.429522:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145403648:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175810.429525:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175810.429535:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175810.429552:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145404288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175810.429562:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175810.429564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175810.429569:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175810.429573:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175810.429579:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00080000:1.0:1786175810.429585:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175810.429590:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2fe680 x1872931145403648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175810.429594:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175810.429602:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175810.429620:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145404416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175810.429624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145403648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175810.429648:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175810.429652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175810.429654:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175810.429660:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175810.429664:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175810.429670:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9544
00000100:00100000:0.0:1786175810.429675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145403648:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175810.429677:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175810.429689:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175810.429694:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145403776:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175810.429697:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175810.429714:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145404544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175810.429726:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175810.429744:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2fdc00 x1872931145403776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175810.429757:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145403776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175810.429766:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175810.429769:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175810.429772:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145403776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175810.429778:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145403904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175810.429819:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175810.429832:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2ff480 x1872931145403904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175810.429846:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145403904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175810.429856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175810.429859:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175810.429863:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145403904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175810.429869:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145404032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175810.429889:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175810.429899:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2fd880 x1872931145404032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175810.429946:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145404032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175810.429983:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175810.430008:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175810.430011:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145404032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175810.430018:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145404160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175810.430040:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175810.430051:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2fce00 x1872931145404160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175810.430063:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145404160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175810.430071:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175810.430074:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175810.430077:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145404160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175810.430095:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145404288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175810.430110:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175810.430119:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2fc700 x1872931145404288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175810.430130:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145404288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175810.430138:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175810.430140:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175810.430143:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145404288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175810.430147:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145404416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175810.430161:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175810.430169:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2fdf80 x1872931145404416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175810.430180:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145404416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175810.430194:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175810.430197:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175810.430200:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145404416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175810.430204:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145404544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175810.430217:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175810.430225:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175810/real 1786175810]  req@ffff89d9ba2fd180 x1872931145404544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175810.430235:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145404544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175810.430243:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175810.430245:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175810.430248:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145404544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175810.941046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175810.941135:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175811.453073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175811.965002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175811.965111:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175812.477047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175812.989072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175812.989203:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175813.501005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175814.012980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175814.013117:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175814.525007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175815.037103:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175815.037218:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175815.548986:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175815.549003:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175815.549010:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175815.549025:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00100000:3.0:1786175815.549037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175815.549039:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549053:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175815.549108:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145404672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175815.549146:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175815.549149:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175815.549151:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175815.549154:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00080000:1.0:1786175815.549157:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549160:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175815.549171:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175815.549184:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145404800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175815.549199:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175815.549203:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175815.549207:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175815.549214:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145404672:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175815.549216:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00080000:1.0:1786175815.549227:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549236:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175815.549240:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175815.549251:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145404928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175815.549257:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175815.549262:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175815.549264:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175815.549269:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00080000:1.0:1786175815.549272:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549275:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175815.549279:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175815.549289:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145405056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175815.549298:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175815.549301:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175815.549303:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175815.549305:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00080000:1.0:1786175815.549317:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549321:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175815.549326:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175815.549338:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175815.549339:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145405184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175815.549358:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175815.549362:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175815.549365:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175815.549371:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00080000:1.0:1786175815.549378:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549382:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175815.549386:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175815.549399:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145405312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175815.549408:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175815.549411:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175815.549413:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175815.549419:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2fed80 x1872931145404672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175815.549420:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00080000:1.0:1786175815.549438:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549454:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175815.549471:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175815.549479:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145404672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175815.549494:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145405440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175815.549502:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.549523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175815.549536:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175815.549544:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145404672:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175815.549545:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175815.549549:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175815.549558:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00080000:1.0:1786175815.549566:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549571:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175815.549577:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175815.549590:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145405568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175815.549598:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175815.549604:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175815.549607:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175815.549609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145404800:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175815.549616:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9549
00000100:00080000:1.0:1786175815.549623:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175815.549632:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175815.549637:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175815.549649:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145405696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175815.549679:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175815.549711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2fe300 x1872931145404800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175815.549738:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145404800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175815.549757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.549765:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175815.549772:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145404800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175815.549788:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145404928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175815.549825:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175815.549851:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2ff800 x1872931145404928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175815.549867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145404928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175815.549878:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.549883:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175815.549887:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145404928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175815.549955:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145405056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175815.549995:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175815.550012:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2ffb80 x1872931145405056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175815.550027:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145405056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175815.550038:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.550042:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175815.550046:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145405056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175815.550054:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145405184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175815.550074:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175815.550086:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2ff100 x1872931145405184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175815.550100:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145405184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175815.550109:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.550113:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175815.550117:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145405184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175815.550124:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145405312:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175815.550142:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175815.550153:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2fea00 x1872931145405312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175815.550168:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145405312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175815.550178:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.550181:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175815.550185:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145405312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175815.550192:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145405440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175815.550210:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175815.550222:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2fd500 x1872931145405440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175815.550236:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145405440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175815.550245:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.550248:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175815.550252:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145405440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175815.550282:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145405568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175815.550301:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175815.550313:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2fc380 x1872931145405568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175815.550326:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145405568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175815.550345:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.550349:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175815.550353:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145405568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175815.550360:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145405696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175815.550379:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175815.550389:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175815/real 1786175815]  req@ffff89d9ba2fed80 x1872931145405696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175815.550403:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145405696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175815.550413:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175815.550416:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175815.550420:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145405696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175816.061044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175816.061203:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175816.573060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175817.085084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175817.085172:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175817.597018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175818.109094:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175818.109162:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175818.620963:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175819.133037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175819.133150:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175819.645045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175820.157058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175820.157162:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175820.669043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175820.669046:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669061:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175820.669069:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175820.669082:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669095:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175820.669106:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175820.669151:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145405824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175820.669198:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669203:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175820.669205:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175820.669210:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669215:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175820.669221:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175820.669233:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175820.669249:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145405952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175820.669267:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669275:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175820.669281:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175820.669283:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145405824:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175820.669292:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669310:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175820.669318:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175820.669324:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175820.669343:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145406080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175820.669356:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669372:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175820.669375:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175820.669381:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669387:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175820.669391:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175820.669398:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175820.669413:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145406208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175820.669425:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669429:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175820.669432:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175820.669444:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669459:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175820.669464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175820.669481:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175820.669489:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175820.669505:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145406336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175820.669519:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669523:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175820.669526:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175820.669534:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669542:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175820.669551:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175820.669559:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175820.669583:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145406464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175820.669610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f0700 x1872931145405824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175820.669620:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669640:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175820.669645:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175820.669653:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145405824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175820.669662:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669689:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175820.669692:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.669699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.669704:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145405824:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175820.669724:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175820.669734:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175820.669755:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145406592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175820.669767:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145405952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175820.669777:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669784:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175820.669787:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175820.669794:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669810:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175820.669815:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175820.669820:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175820.669835:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145406720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175820.669849:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175820.669877:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175820.669882:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175820.669889:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9554
00000100:00080000:0.0:1786175820.669957:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175820.669964:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175820.669974:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175820.669979:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175820.670014:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145406848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175820.670033:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f1500 x1872931145405952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175820.670060:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145405952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175820.670072:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.670078:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.670082:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145405952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175820.670092:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145406080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175820.670138:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175820.670149:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f2680 x1872931145406080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175820.670161:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145406080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175820.670169:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.670172:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.670174:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145406080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175820.670180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145406208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175820.670198:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175820.670206:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f2d80 x1872931145406208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175820.670217:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145406208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175820.670224:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.670227:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.670229:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145406208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175820.670234:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145406336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175820.670250:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175820.670259:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f2a00 x1872931145406336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175820.670269:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145406336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175820.670276:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.670279:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.670281:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145406336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175820.670287:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145406464:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175820.670301:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175820.670310:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f3480 x1872931145406464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175820.670319:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145406464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175820.670326:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.670329:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.670332:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145406464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175820.670354:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145406592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175820.670369:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175820.670378:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f3100 x1872931145406592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175820.670397:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145406592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175820.670404:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.670407:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.670409:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145406592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175820.670415:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145406720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175820.670429:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175820.670438:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f0e00 x1872931145406720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175820.670449:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145406720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175820.670460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.670464:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.670469:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145406720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175820.670478:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145406848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175820.670505:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175820.670522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175820/real 1786175820]  req@ffff89d9870f1880 x1872931145406848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175820.670541:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145406848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175820.670557:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175820.670560:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175820.670564:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145406848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175821.181029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175821.181144:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175821.693024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175822.205047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175822.205171:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175822.716984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175823.229012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175823.229087:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175823.741007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175824.252977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175824.253056:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175824.764976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175825.277034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175825.277132:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175825.789072:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789085:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175825.789092:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175825.789102:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175825.789105:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789124:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175825.789136:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175825.789184:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145406976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175825.789226:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789231:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175825.789234:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175825.789238:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789243:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175825.789247:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175825.789259:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175825.789276:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145407104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175825.789291:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789296:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175825.789300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175825.789305:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789310:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175825.789317:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145406976:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175825.789319:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175825.789332:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175825.789347:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145407232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175825.789361:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789365:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175825.789367:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175825.789372:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789376:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175825.789380:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175825.789387:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175825.789402:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145407360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175825.789415:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789419:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175825.789421:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175825.789425:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789431:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175825.789440:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175825.789441:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175825.789452:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175825.789467:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145407488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175825.789478:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789483:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175825.789486:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175825.789490:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789510:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175825.789517:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175825.789523:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175825.789549:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145407616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175825.789552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87ca80 x1872931145406976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175825.789578:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789593:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175825.789601:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175825.789606:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789613:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175825.789618:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175825.789626:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175825.789629:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145406976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175825.789643:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145407744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175825.789678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175825.789679:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789693:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175825.789698:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175825.789699:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175825.789714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145406976:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175825.789715:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789724:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175825.789733:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175825.789739:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175825.789752:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145407872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175825.789759:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145407104:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175825.789773:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175825.789779:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175825.789781:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175825.789786:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9560
00000100:00080000:2.0:1786175825.789791:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175825.789795:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175825.789800:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175825.789840:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145408000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175825.789858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175825.789893:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87e680 x1872931145407104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175825.789958:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145407104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175825.789970:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175825.789987:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175825.789992:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145407104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175825.790023:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145407232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175825.790055:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175825.790070:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87dc00 x1872931145407232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175825.790086:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145407232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175825.790096:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175825.790101:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175825.790105:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145407232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175825.790112:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145407360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175825.790133:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175825.790144:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87f100 x1872931145407360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175825.790158:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145407360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175825.790176:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175825.790180:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175825.790184:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145407360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175825.790190:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145407488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175825.790208:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175825.790219:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87ed80 x1872931145407488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175825.790233:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145407488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175825.790243:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175825.790246:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175825.790250:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145407488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175825.790256:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145407616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175825.790274:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175825.790284:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87d500 x1872931145407616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175825.790297:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145407616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175825.790307:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175825.790310:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175825.790315:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145407616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175825.790322:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145407744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175825.790348:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175825.790369:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87c380 x1872931145407744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175825.790394:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145407744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175825.790411:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175825.790417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175825.790424:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145407744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175825.790437:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145407872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175825.790469:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175825.790485:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87df80 x1872931145407872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175825.790500:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145407872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175825.790511:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175825.790515:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175825.790519:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145407872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175825.790526:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145408000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175825.790544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175825.790560:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175825/real 1786175825]  req@ffff89d99e87f800 x1872931145408000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175825.790583:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145408000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175825.790599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175825.790605:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175825.790612:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145408000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175826.301022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175826.301076:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175826.812991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175827.325108:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175827.325147:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175827.836996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175828.349051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175828.349129:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175828.860973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175829.373005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175829.373076:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175829.885003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175830.397028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175830.397116:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175830.908980:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175830.908989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175830.908991:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175830.908997:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175830.909009:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00080000:2.0:1786175830.909018:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175830.909026:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175830.909063:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145408128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175830.909095:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175830.909098:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175830.909100:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175830.909103:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00080000:2.0:1786175830.909106:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175830.909109:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175830.909118:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175830.909127:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145408256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175830.909135:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175830.909138:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175830.909139:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175830.909142:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00080000:2.0:1786175830.909144:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175830.909146:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175830.909149:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175830.909156:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145408384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175830.909163:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175830.909166:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175830.909168:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175830.909171:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00080000:2.0:1786175830.909174:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175830.909177:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175830.909182:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175830.909190:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145408512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175830.909199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145408128:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175830.909218:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175830.909224:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175830.909226:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175830.909230:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00080000:2.0:1786175830.909233:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175830.909236:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175830.909243:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175830.909261:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145408640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175830.909275:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175830.909280:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175830.909283:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175830.909290:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175830.909292:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00080000:2.0:1786175830.909302:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175830.909309:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175830.909317:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175830.909337:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145408768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175830.909351:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87c000 x1872931145408128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175830.909353:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175830.909367:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175830.909374:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175830.909385:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00080000:2.0:1786175830.909392:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175830.909393:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145408128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175830.909419:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175830.909429:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175830.909437:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175830.909444:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145408896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175830.909449:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.909460:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145408128:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175830.909462:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175830.909470:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175830.909472:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175830.909477:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00100000:0.0:1786175830.909479:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145408256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175830.909481:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175830.909490:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175830.909494:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175830.909505:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145409024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175830.909513:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175830.909518:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175830.909519:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175830.909524:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175830.909529:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9565
00000100:00080000:2.0:1786175830.909533:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175830.909539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87c700 x1872931145408256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175830.909539:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175830.909547:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175830.909563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145408256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175830.909564:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145409152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175830.909600:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175830.909608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.909613:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145408256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175830.909622:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145408384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175830.909651:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175830.909668:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87d880 x1872931145408384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175830.909680:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145408384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175830.909704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175830.909709:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.909715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145408384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175830.909741:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145408512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175830.909810:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175830.909824:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87f800 x1872931145408512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175830.909843:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145408512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175830.909856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175830.909861:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.909867:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145408512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175830.909878:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145408640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175830.909906:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175830.909956:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87df80 x1872931145408640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175830.909971:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145408640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175830.909980:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175830.909984:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.909987:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145408640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175830.909996:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145408768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175830.910012:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175830.910023:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87c380 x1872931145408768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175830.910033:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145408768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175830.910039:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175830.910042:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.910046:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145408768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175830.910053:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145408896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175830.910066:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175830.910076:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87d500 x1872931145408896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175830.910088:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145408896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175830.910095:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175830.910097:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.910099:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145408896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175830.910103:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145409024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175830.910114:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175830.910121:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87ed80 x1872931145409024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175830.910129:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145409024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175830.910135:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175830.910137:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.910139:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145409024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175830.910143:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145409152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175830.910156:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175830.910163:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175830/real 1786175830]  req@ffff89d99e87f100 x1872931145409152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175830.910171:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145409152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175830.910177:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175830.910180:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175830.910182:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145409152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175831.421027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175831.421111:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175831.932992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175832.445016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175832.445078:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175832.956965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175833.469061:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175833.469163:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175833.980973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175834.492994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175834.493071:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175835.004973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175835.516994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175835.517059:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175836.029050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175836.029060:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175836.029071:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175836.029077:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175836.029090:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00080000:2.0:1786175836.029118:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029130:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175836.029192:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145409280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175836.029229:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175836.029234:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175836.029237:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175836.029242:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00080000:2.0:1786175836.029246:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029250:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175836.029263:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175836.029280:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145409408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175836.029294:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175836.029306:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786175836.029307:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145409280:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175836.029313:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175836.029325:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00080000:2.0:1786175836.029330:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029338:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175836.029345:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175836.029367:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145409536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175836.029377:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175836.029381:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175836.029383:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175836.029386:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00080000:2.0:1786175836.029390:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029393:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175836.029398:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175836.029410:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175836.029412:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145409664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175836.029427:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175836.029431:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175836.029433:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175836.029439:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00080000:2.0:1786175836.029444:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029448:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175836.029453:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175836.029463:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145409792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175836.029472:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175836.029476:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175836.029478:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175836.029481:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00080000:2.0:1786175836.029486:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029491:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175836.029497:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87dc00 x1872931145409280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175836.029504:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175836.029542:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145409920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175836.029545:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145409280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175836.029612:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175836.029620:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175836.029621:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175836.029634:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175836.029641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175836.029649:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00100000:0.0:1786175836.029657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145409280:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175836.029659:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029672:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175836.029679:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175836.029691:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145410048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175836.029702:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175836.029703:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145409408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175836.029753:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175836.029757:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175836.029766:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00080000:2.0:1786175836.029774:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029790:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175836.029798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175836.029806:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175836.029822:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87e680 x1872931145409408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175836.029836:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145410176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175836.029849:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145409408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175836.029879:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175836.029885:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175836.029887:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175836.029925:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175836.029933:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145409408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175836.029944:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145409536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175836.029947:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175836.029960:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9570
00000100:00080000:2.0:1786175836.029974:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175836.029982:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175836.029988:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175836.029990:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175836.030020:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145410304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175836.030022:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87ca80 x1872931145409536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175836.030124:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145409536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175836.030139:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175836.030146:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175836.030152:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145409536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175836.030167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145409664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175836.030208:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175836.030232:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87f100 x1872931145409664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175836.030259:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145409664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175836.030271:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175836.030275:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175836.030279:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145409664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175836.030288:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145409792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175836.030316:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175836.030330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87ed80 x1872931145409792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175836.030344:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145409792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175836.030353:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175836.030357:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175836.030360:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145409792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175836.030368:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145409920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175836.030386:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175836.030397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87d500 x1872931145409920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175836.030412:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145409920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175836.030421:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175836.030425:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175836.030429:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145409920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175836.030455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145410048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175836.030474:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175836.030487:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87c380 x1872931145410048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175836.030500:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145410048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175836.030510:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175836.030514:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175836.030518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145410048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175836.030525:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145410176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175836.030543:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175836.030553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87df80 x1872931145410176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175836.030567:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145410176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175836.030577:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175836.030581:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175836.030584:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145410176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175836.030591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145410304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175836.030608:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175836.030619:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175836/real 1786175836]  req@ffff89d99e87f800 x1872931145410304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175836.030633:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145410304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175836.030643:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175836.030647:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175836.030650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145410304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175836.541041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175836.541207:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175837.052991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175837.565042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175837.565135:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175838.077079:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175838.589048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175838.589196:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175839.101105:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175839.613060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175839.613133:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175840.124980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175840.637072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175840.637134:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175841.149018:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175841.149027:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175841.149033:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175841.149043:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149054:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175841.149056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175841.149064:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175841.149108:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145410432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175841.149140:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175841.149144:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175841.149146:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175841.149149:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149153:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175841.149157:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175841.149166:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175841.149173:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145410432:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175841.149180:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145410560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175841.149189:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175841.149191:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175841.149193:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175841.149196:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149198:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175841.149200:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175841.149204:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175841.149213:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145410688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175841.149219:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175841.149222:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175841.149223:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175841.149225:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149227:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175841.149229:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175841.149233:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175841.149233:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175841.149244:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145410816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175841.149255:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175841.149257:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175841.149258:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175841.149261:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149263:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175841.149265:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175841.149269:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175841.149279:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145410944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175841.149280:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87d880 x1872931145410432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175841.149293:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175841.149301:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175841.149304:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175841.149310:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149313:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175841.149316:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175841.149319:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175841.149322:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145410432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175841.149332:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175841.149337:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175841.149337:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145411072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175841.149344:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145410432:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175841.149355:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175841.149358:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175841.149359:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175841.149363:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149366:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175841.149369:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175841.149373:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175841.149374:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145410560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175841.149385:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145411200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175841.149394:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175841.149396:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175841.149398:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175841.149402:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175841.149404:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149409:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175841.149412:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175841.149416:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175841.149418:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87c700 x1872931145410560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175841.149427:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145411328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175841.149432:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145410560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175841.149441:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175841.149445:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175841.149446:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175841.149452:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175841.149454:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145410560:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175841.149455:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175841.149463:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145410688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175841.149464:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9575
00000100:00080000:2.0:1786175841.149470:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175841.149474:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175841.149478:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175841.149486:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175841.149490:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145411456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175841.149497:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87c000 x1872931145410688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175841.149527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145410688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175841.149542:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175841.149544:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175841.149546:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145410688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175841.149567:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145410816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175841.149583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175841.149592:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87f800 x1872931145410816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175841.149600:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145410816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175841.149606:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175841.149609:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175841.149611:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145410816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175841.149615:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145410944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175841.149626:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175841.149633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87df80 x1872931145410944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175841.149641:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145410944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175841.149646:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175841.149648:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175841.149650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145410944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175841.149654:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145411072:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175841.149684:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175841.149692:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87c380 x1872931145411072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175841.149700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145411072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175841.149706:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175841.149708:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175841.149711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145411072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175841.149725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145411200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175841.149736:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175841.149743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87d500 x1872931145411200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175841.149751:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145411200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175841.149757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175841.149759:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175841.149761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145411200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175841.149765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145411328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175841.149776:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175841.149782:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87ed80 x1872931145411328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175841.149791:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145411328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175841.149796:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175841.149798:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175841.149800:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145411328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175841.149804:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145411456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175841.149814:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175841.149820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175841/real 1786175841]  req@ffff89d99e87f100 x1872931145411456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175841.149828:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145411456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175841.149834:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175841.149836:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175841.149838:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145411456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175841.660982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175841.661066:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175842.173038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175842.684977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175842.685040:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175843.197043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175843.709002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175843.709163:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175844.221056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175844.733072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175844.733153:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175845.245071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175845.757036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175845.757211:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175846.269020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175846.269037:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175846.269045:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175846.269050:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269058:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:0.0:1786175846.269066:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175846.269073:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175846.269113:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145411584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175846.269153:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175846.269157:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175846.269159:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269162:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:0.0:1786175846.269165:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175846.269169:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175846.269177:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175846.269189:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145411712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175846.269198:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175846.269200:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175846.269202:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269206:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:0.0:1786175846.269209:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175846.269209:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145411584:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175846.269216:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175846.269220:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175846.269236:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145411840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175846.269257:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175846.269261:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175846.269263:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269268:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:0.0:1786175846.269273:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175846.269276:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175846.269282:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175846.269288:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175846.269302:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145411968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175846.269309:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175846.269312:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175846.269313:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269316:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:0.0:1786175846.269318:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175846.269320:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175846.269324:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175846.269331:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f3b80 x1872931145411584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175846.269332:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145412096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175846.269353:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175846.269357:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175846.269359:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269362:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:0.0:1786175846.269365:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175846.269369:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145411584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175846.269370:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175846.269376:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175846.269386:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175846.269387:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145412224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175846.269395:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175846.269404:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175846.269405:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145411584:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175846.269410:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175846.269413:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269417:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:0.0:1786175846.269419:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175846.269422:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175846.269425:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175846.269431:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145411712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175846.269435:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145412352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175846.269444:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175846.269446:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175846.269448:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269450:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:0.0:1786175846.269454:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175846.269458:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175846.269459:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175846.269465:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175846.269473:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f0a80 x1872931145411712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175846.269476:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145412480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175846.269505:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175846.269508:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145411712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175846.269509:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175846.269513:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175846.269538:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9580
00000100:00080000:2.0:1786175846.269540:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175846.269542:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175846.269546:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175846.269548:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175846.269553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145411712:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786175846.269554:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175846.269565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145411840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175846.269569:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145412608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175846.269588:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175846.269599:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f1180 x1872931145411840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175846.269635:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145411840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175846.269642:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175846.269644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175846.269646:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145411840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175846.269651:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145411968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175846.269668:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175846.269675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f1880 x1872931145411968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175846.269683:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145411968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175846.269688:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175846.269690:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175846.269692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145411968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175846.269696:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145412096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175846.269706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175846.269712:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f0e00 x1872931145412096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175846.269719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145412096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175846.269725:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175846.269727:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175846.269729:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145412096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175846.269732:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145412224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175846.269742:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175846.269748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f3100 x1872931145412224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175846.269755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145412224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175846.269760:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175846.269778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175846.269780:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145412224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175846.269792:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145412352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175846.269804:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175846.269810:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f3480 x1872931145412352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175846.269817:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145412352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175846.269822:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175846.269824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175846.269827:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145412352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175846.269830:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145412480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175846.269840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175846.269846:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f2a00 x1872931145412480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175846.269853:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145412480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175846.269858:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175846.269859:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175846.269861:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145412480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175846.269864:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145412608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175846.269874:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175846.269879:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175846/real 1786175846]  req@ffff89d9870f2d80 x1872931145412608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175846.269886:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145412608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175846.269891:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175846.269893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175846.269895:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145412608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175846.781032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175846.781097:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175847.293032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175847.804995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175847.805055:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175848.316986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175848.828984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175848.829040:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175849.340982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175849.853059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175849.853127:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175850.364994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175850.877099:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175850.877205:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175851.389074:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175851.389085:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1786175851.389087:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175851.389090:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175851.389108:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00080000:1.0:1786175851.389120:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175851.389128:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175851.389180:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145412736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175851.389214:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175851.389217:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175851.389219:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175851.389222:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00080000:1.0:1786175851.389227:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175851.389232:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175851.389245:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175851.389253:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145412736:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175851.389266:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145412864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175851.389281:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175851.389285:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175851.389287:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175851.389292:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00080000:1.0:1786175851.389298:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175851.389301:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175851.389307:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175851.389323:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145412992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175851.389324:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175851.389338:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175851.389341:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175851.389342:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175851.389345:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00080000:1.0:1786175851.389349:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175851.389352:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175851.389356:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175851.389369:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145413120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175851.389375:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2fd180 x1872931145412736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175851.389390:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175851.389404:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175851.389410:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175851.389418:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00080000:1.0:1786175851.389421:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175851.389427:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175851.389427:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145412736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175851.389456:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786175851.389458:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175851.389463:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175851.389471:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145412736:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175851.389477:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145413248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175851.389489:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175851.389493:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175851.389496:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175851.389501:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145412864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175851.389521:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00080000:1.0:1786175851.389529:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175851.389534:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175851.389541:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175851.389544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175851.389584:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145413376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175851.389588:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2fdf80 x1872931145412864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175851.389659:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175851.389664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145412864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175851.389666:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175851.389672:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175851.389688:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00080000:2.0:1786175851.389697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175851.389698:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175851.389704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175851.389709:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175851.389714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145412864:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175851.389718:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175851.389725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145412992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175851.389736:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145413504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175851.389746:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786175851.389751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175851.389760:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175851.389763:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175851.389769:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00100000:2.0:1786175851.389773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2fc700 x1872931145412992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175851.389775:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175851.389787:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175851.389815:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145412992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175851.389820:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175851.389849:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175851.389856:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145413632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175851.389856:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175851.389870:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145412992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175851.389890:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145413120:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175851.389935:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175851.389940:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1786175851.389943:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175851.389953:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2fce00 x1872931145413120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175851.389962:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145413120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175851.389971:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175851.389973:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175851.389979:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175851.389982:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9585
00000100:00080000:1.0:1786175851.389991:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175851.389997:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145413120:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175851.390002:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175851.390011:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175851.390020:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145413248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175851.390029:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145413760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175851.390044:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175851.390058:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2fd880 x1872931145413248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175851.390067:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145413248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175851.390072:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175851.390075:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175851.390077:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145413248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175851.390094:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145413376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175851.390105:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175851.390111:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2ff480 x1872931145413376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175851.390119:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145413376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175851.390124:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175851.390125:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175851.390127:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145413376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175851.390131:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145413504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175851.390141:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175851.390146:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2fdc00 x1872931145413504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175851.390154:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145413504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175851.390158:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175851.390160:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175851.390162:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145413504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175851.390166:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145413632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175851.390175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175851.390181:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2fe680 x1872931145413632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175851.390188:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145413632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175851.390194:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175851.390196:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175851.390197:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145413632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175851.390201:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145413760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175851.390210:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175851.390216:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175851/real 1786175851]  req@ffff89d9ba2fd180 x1872931145413760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175851.390223:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145413760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175851.390228:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175851.390230:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175851.390231:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145413760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175851.901024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175851.901110:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175852.412989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175852.924984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175852.925083:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175853.437025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175853.949016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175853.949113:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175854.460978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175854.973036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175854.973186:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175855.485058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175855.997077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175855.997170:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175856.509096:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509109:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175856.509114:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175856.509123:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175856.509128:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509144:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509154:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175856.509202:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145413888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175856.509239:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509244:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175856.509246:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175856.509250:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509254:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509258:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175856.509271:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175856.509285:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145414016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175856.509303:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145413888:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175856.509306:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509321:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175856.509329:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175856.509336:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509339:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509342:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175856.509347:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175856.509360:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145414144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175856.509370:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509374:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175856.509376:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175856.509380:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509383:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509387:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175856.509391:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175856.509404:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145414272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175856.509412:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509416:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175856.509419:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175856.509424:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509429:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509432:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175856.509438:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175856.509449:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145414400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175856.509458:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509462:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175856.509464:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175856.509468:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509473:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509478:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175856.509482:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175856.509495:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145414528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175856.509504:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509532:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175856.509534:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175856.509539:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509544:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509550:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175856.509559:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175856.509584:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145414016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175856.509585:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145414656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175856.509622:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509626:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175856.509628:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175856.509636:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509642:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509648:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175856.509655:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175856.509671:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145414784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175856.509680:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145414144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175856.509686:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175856.509698:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175856.509700:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175856.509705:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9590
00000100:00080000:1.0:1786175856.509710:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175856.509714:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175856.509720:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175856.509741:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145414912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175856.509753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145414272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175856.509794:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145414400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175856.509825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145414528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175856.509847:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145414656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175856.509865:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145414784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175856.509881:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145414912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175857.021009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175857.021074:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175857.532992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175858.045001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175858.045098:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175858.557052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175859.069023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175859.069104:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175859.580994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786175859.581332:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786175859.581379:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786175859.581396:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175859.581444:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786175859.581457:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175859.581466:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175859.581475:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175859.581501:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175859.581510:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175859.581520:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2fd180 x1872931145414912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786175859.581522:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786175859.581535:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175859.581559:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145414912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581574:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581578:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581583:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145414912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175859.581592:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2fc380 x1872931145414016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175859.581607:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145414016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581616:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581620:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145414016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175859.581634:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2fd500 x1872931145414144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175859.581648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145414144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581657:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581661:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581664:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145414144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175859.581671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2fea00 x1872931145414272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175859.581683:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145414272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145414272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175859.581705:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2ff100 x1872931145414400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175859.581716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145414400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581724:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581727:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145414400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175859.581736:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2ffb80 x1872931145414528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175859.581747:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145414528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581753:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581756:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581759:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145414528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175859.581765:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2fed80 x1872931145413888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175859.581776:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145413888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581782:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581785:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581788:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145413888:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175859.581820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2ff800 x1872931145414656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175859.581831:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145414656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581842:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145414656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175859.581853:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175856/real 1786175859]  req@ffff89d9ba2fe300 x1872931145414784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175859.581865:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145414784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175859.581873:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175859.581877:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175859.581880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145414784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175860.093036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175860.093205:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175860.605011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175861.117034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175861.117060:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175861.628986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175861.629051:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175861.629057:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175861.629061:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175861.629072:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00080000:1.0:1786175861.629084:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175861.629093:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175861.629134:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145415040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175861.629165:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175861.629169:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175861.629172:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175861.629176:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00080000:1.0:1786175861.629181:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175861.629185:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175861.629199:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175861.629215:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145415040:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175861.629218:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145415168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175861.629233:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175861.629236:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175861.629238:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175861.629241:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00080000:1.0:1786175861.629245:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175861.629248:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175861.629253:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175861.629264:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145415296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175861.629277:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175861.629280:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175861.629281:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175861.629283:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00080000:1.0:1786175861.629286:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175861.629289:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175861.629293:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786175861.629294:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175861.629306:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145415424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175861.629316:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175861.629321:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175861.629323:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175861.629327:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00080000:1.0:1786175861.629331:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175861.629336:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175861.629341:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175861.629347:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2fe680 x1872931145415040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175861.629356:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145415552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175861.629374:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175861.629378:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175861.629380:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175861.629384:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00080000:1.0:1786175861.629390:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175861.629395:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145415040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175861.629397:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175861.629405:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175861.629416:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175861.629423:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145415680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175861.629426:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175861.629435:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145415040:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175861.629443:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175861.629448:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175861.629450:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175861.629455:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00080000:1.0:1786175861.629478:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175861.629482:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175861.629488:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175861.629491:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145415168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175861.629504:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145415808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175861.629518:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175861.629522:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175861.629524:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175861.629529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175861.629532:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00080000:1.0:1786175861.629539:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175861.629546:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175861.629552:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175861.629553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2fdc00 x1872931145415168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175861.629571:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145415936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175861.629584:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145415168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175861.629602:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175861.629606:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175861.629607:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175861.629614:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175861.629616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175861.629623:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9595
00000100:00100000:0.0:1786175861.629625:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145415168:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175861.629632:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175861.629638:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145415296:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175861.629641:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175861.629651:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175861.629671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175861.629680:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145416064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175861.629689:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2ff480 x1872931145415296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175861.629707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145415296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175861.629716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175861.629720:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175861.629724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145415296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175861.629731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145415424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175861.629752:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175861.629764:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2fd880 x1872931145415424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175861.629775:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145415424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175861.629788:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175861.629791:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175861.629794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145415424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175861.629799:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145415552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175861.629817:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175861.629827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2fce00 x1872931145415552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175861.629839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145415552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175861.629846:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175861.629850:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175861.629853:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145415552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175861.629860:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145415680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175861.629879:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175861.629890:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2fc700 x1872931145415680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175861.629945:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145415680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175861.629967:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175861.629971:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175861.629976:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145415680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175861.630004:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145415808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175861.630028:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175861.630039:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2fdf80 x1872931145415808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175861.630052:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145415808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175861.630060:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175861.630063:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175861.630067:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145415808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175861.630074:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145415936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175861.630093:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175861.630105:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2fe680 x1872931145415936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175861.630118:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145415936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175861.630128:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175861.630132:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175861.630135:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145415936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175861.630142:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145416064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175861.630163:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175861.630175:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175861/real 1786175861]  req@ffff89d9ba2fe300 x1872931145416064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175861.630187:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145416064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175861.630197:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175861.630201:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175861.630205:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145416064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175862.141008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175862.141090:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175862.652987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175863.164997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175863.165112:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175863.676979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175864.188994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175864.189080:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175864.700958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175865.213022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175865.213112:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175865.725035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175866.237015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175866.237080:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175866.749065:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175866.749077:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175866.749082:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749095:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749109:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175866.749128:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175866.749133:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175866.749209:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145416192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175866.749253:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175866.749258:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175866.749261:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749268:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749273:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175866.749280:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175866.749293:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175866.749299:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145416192:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175866.749315:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145416320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175866.749333:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175866.749337:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175866.749340:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749346:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749352:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175866.749356:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175866.749362:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175866.749383:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145416448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175866.749393:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175866.749396:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175866.749398:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749401:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749403:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175866.749429:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175866.749435:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175866.749447:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145416576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175866.749475:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786175866.749478:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175866.749479:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175866.749487:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749490:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749493:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175866.749496:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175866.749500:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175866.749507:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145416704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175866.749514:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175866.749517:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175866.749518:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749520:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749522:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175866.749525:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175866.749527:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175866.749534:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145416832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175866.749540:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175866.749542:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175866.749543:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749547:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749550:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175866.749552:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175866.749556:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175866.749564:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145416960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175866.749570:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175866.749573:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175866.749574:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749577:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749583:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175866.749588:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175866.749592:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175866.749606:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145417088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175866.749617:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175866.749621:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175866.749623:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175866.749628:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9600
00000100:00080000:1.0:1786175866.749632:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175866.749636:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175866.749642:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175866.749660:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145417216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175866.749736:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2ff800 x1872931145416192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.749757:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145416192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.749767:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.749772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.749776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145416192:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175866.749843:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145416320:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175866.749872:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175866.749889:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2fed80 x1872931145416320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.749941:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145416320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.749948:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.749951:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.749954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145416320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175866.749959:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145416448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175866.749979:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175866.749989:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2ffb80 x1872931145416448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.749999:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145416448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.750010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.750013:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.750015:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145416448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175866.750018:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145416576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175866.750031:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175866.750037:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2ff100 x1872931145416576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.750044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145416576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.750050:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.750052:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.750054:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145416576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175866.750058:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145416704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175866.750069:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175866.750075:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2fea00 x1872931145416704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.750083:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145416704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.750088:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.750090:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.750093:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145416704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175866.750097:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145416832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175866.750108:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175866.750114:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2fd500 x1872931145416832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.750121:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145416832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.750127:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.750129:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.750131:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145416832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175866.750134:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145416960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175866.750145:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175866.750150:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2fc380 x1872931145416960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.750157:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145416960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.750163:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.750164:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.750166:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145416960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175866.750170:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145417088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175866.750180:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175866.750186:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2fd180 x1872931145417088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.750194:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145417088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.750200:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.750202:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.750204:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145417088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175866.750207:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145417216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175866.750217:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175866.750222:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175866/real 1786175866]  req@ffff89d9ba2fe300 x1872931145417216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175866.750229:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145417216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175866.750234:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175866.750236:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175866.750237:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145417216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175867.261083:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175867.261191:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175867.772992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175868.284992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175868.285059:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175868.797006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175869.309028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175869.309106:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175869.820974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175870.332993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175870.333073:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175870.844995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175871.357087:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175871.357194:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175871.869041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175871.869041:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175871.869050:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175871.869055:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869063:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00080000:3.0:1786175871.869071:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175871.869078:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175871.869112:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145417344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175871.869134:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175871.869137:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175871.869139:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869141:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00080000:3.0:1786175871.869144:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175871.869147:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175871.869155:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175871.869164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145417344:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175871.869166:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145417472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175871.869178:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175871.869180:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175871.869182:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869185:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00080000:3.0:1786175871.869188:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175871.869190:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175871.869193:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175871.869202:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145417600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175871.869214:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175871.869217:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175871.869218:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869220:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00080000:3.0:1786175871.869222:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175871.869226:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175871.869227:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175871.869233:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175871.869241:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145417728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175871.869247:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175871.869249:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175871.869250:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869253:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00080000:3.0:1786175871.869255:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175871.869258:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175871.869261:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175871.869270:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe66680 x1872931145417344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175871.869272:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145417856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175871.869283:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175871.869292:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175871.869297:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869305:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00080000:3.0:1786175871.869310:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175871.869311:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145417344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175871.869315:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175871.869324:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175871.869328:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175871.869333:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175871.869336:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145417984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175871.869340:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145417344:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175871.869352:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175871.869355:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175871.869357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869375:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00080000:3.0:1786175871.869378:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175871.869382:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145417472:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175871.869385:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175871.869391:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175871.869402:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145418112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175871.869410:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175871.869413:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175871.869415:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175871.869417:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869422:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00080000:3.0:1786175871.869425:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175871.869429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe65880 x1872931145417472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175871.869430:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175871.869436:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175871.869447:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145418240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175871.869450:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145417472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175871.869478:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175871.869481:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175871.869482:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175871.869485:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175871.869490:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145417472:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175871.869490:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175871.869498:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9606
00000100:00100000:0.0:1786175871.869502:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145417600:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175871.869502:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175871.869508:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175871.869512:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175871.869521:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145418368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175871.869527:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175871.869536:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe67480 x1872931145417600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175871.869548:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145417600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175871.869559:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175871.869563:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175871.869565:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145417600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175871.869569:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145417728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175871.869580:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175871.869586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe65500 x1872931145417728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175871.869601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145417728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175871.869606:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175871.869608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175871.869610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145417728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175871.869614:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145417856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175871.869628:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175871.869634:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe64a80 x1872931145417856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175871.869642:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145417856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175871.869647:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175871.869648:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175871.869651:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145417856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175871.869655:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145417984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175871.869664:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175871.869670:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe66a00 x1872931145417984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175871.869676:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145417984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175871.869681:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175871.869683:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175871.869685:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145417984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175871.869696:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145418112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175871.869706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175871.869712:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe67100 x1872931145418112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175871.869720:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145418112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175871.869725:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175871.869727:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175871.869729:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145418112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175871.869732:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145418240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175871.869760:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175871.869772:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe64000 x1872931145418240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175871.869786:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145418240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175871.869797:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175871.869801:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175871.869804:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145418240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175871.869812:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145418368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175871.869834:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175871.869844:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175871/real 1786175871]  req@ffff89d99fe66680 x1872931145418368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175871.869853:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145418368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175871.869860:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175871.869862:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175871.869865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145418368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175872.381003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175872.381087:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175872.893102:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175873.405070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175873.405172:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175873.917071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175874.429038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175874.429122:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175874.940980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175875.452995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175875.453082:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175875.965011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175876.477025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175876.477139:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175876.989010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175876.989017:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175876.989036:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175876.989040:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175876.989051:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9611
00000100:00080000:2.0:1786175876.989064:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175876.989073:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175876.989126:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145418496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175876.989156:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175876.989160:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175876.989163:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175876.989168:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9611
00000100:00080000:2.0:1786175876.989172:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175876.989178:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175876.989186:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145418496:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786175876.989188:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175876.989210:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145418624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175876.989222:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175876.989226:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175876.989229:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175876.989234:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9611
00000100:00080000:2.0:1786175876.989239:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175876.989245:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175876.989246:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175876.989255:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175876.989272:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145418752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175876.989284:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175876.989287:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175876.989289:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175876.989294:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9611
00000100:00100000:0.0:1786175876.989298:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87ca80 x1872931145418496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989324:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175876.989332:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145418496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989334:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175876.989347:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175876.989349:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.989355:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175876.989359:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145418496:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175876.989370:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145418880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175876.989380:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145418624:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175876.989388:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175876.989394:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175876.989397:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175876.989404:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9611
00000800:00000100:0.0:1786175876.989405:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175876.989414:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175876.989419:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87e680 x1872931145418624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989421:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175876.989434:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175876.989438:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145418624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175876.989446:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.989449:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175876.989454:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145419008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175876.989455:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145418624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175876.989466:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145418752:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175876.989479:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175876.989484:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:0.0:1786175876.989487:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175876.989487:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175876.989496:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9611
00000100:00100000:0.0:1786175876.989500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87dc00 x1872931145418752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989504:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175876.989517:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145418752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989517:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175876.989526:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175876.989537:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.989542:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175876.989543:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145419136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175876.989546:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145418752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175876.989567:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145418880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175876.989587:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175876.989587:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175876.989595:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175876.989598:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175876.989600:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87f100 x1872931145418880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989607:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9611
00000100:00100000:0.0:1786175876.989616:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145418880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989616:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175876.989627:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175876.989628:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.989636:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175876.989638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145418880:192.168.202.130@tcp:8:kworker.0
00000008:00100000:2.0:1786175876.989639:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175876.989645:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145419008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175876.989662:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145419264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175876.989663:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175876.989673:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87ed80 x1872931145419008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989681:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175876.989686:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145419008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175876.989689:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175876.989695:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175876.989698:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.989705:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175876.989705:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9611
00000100:00100000:0.0:1786175876.989711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145419008:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175876.989715:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175876.989722:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145419136:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175876.989725:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175876.989735:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175876.989740:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175876.989749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87d500 x1872931145419136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175876.989757:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145419392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175876.989763:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145419136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175876.989783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.989788:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175876.989789:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175876.989792:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145419136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175876.989809:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145419264:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175876.989810:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175876.989816:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175876.989823:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9611
00000800:00000100:0.0:1786175876.989828:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175876.989832:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175876.989840:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175876.989845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87c380 x1872931145419264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175876.989849:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175876.989870:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145419520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175876.989871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145419264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175876.989920:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.989924:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175876.989931:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145419264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175876.989951:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145419392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175876.989971:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175876.989985:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87df80 x1872931145419392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175876.989995:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145419392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175876.990001:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.990004:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175876.990006:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145419392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175876.990010:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145419520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175876.990021:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175876.990027:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175876/real 1786175876]  req@ffff89d99e87f800 x1872931145419520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175876.990034:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145419520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175901 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175876.990040:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175876.990042:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175876.990044:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145419520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175877.501084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175877.501168:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175878.013189:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175878.524982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175878.525087:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175879.037000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175879.548979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175879.549045:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175880.060990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175880.573015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175880.573097:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175881.085027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175881.597045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175881.597100:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175882.108986:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175882.108986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175882.108997:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175882.109002:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175882.109011:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9616
00000100:00080000:2.0:1786175882.109021:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109029:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175882.109063:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145419648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175882.109086:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175882.109090:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175882.109092:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175882.109096:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9616
00000100:00080000:2.0:1786175882.109100:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109105:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175882.109114:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175882.109126:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145419776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175882.109128:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145419648:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175882.109137:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175882.109142:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175882.109144:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175882.109148:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9616
00000100:00080000:2.0:1786175882.109151:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109154:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175882.109159:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175882.109167:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145419904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175882.109176:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175882.109178:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175882.109180:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175882.109183:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9616
00000800:00000100:0.0:1786175882.109186:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175882.109186:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109190:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175882.109194:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175882.109203:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145420032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175882.109211:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175882.109214:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175882.109216:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175882.109220:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9616
00000100:00080000:2.0:1786175882.109223:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109226:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109232:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87c000 x1872931145419648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175882.109232:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175882.109241:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145420160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175882.109249:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175882.109250:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145419648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175882.109253:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175882.109254:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175882.109258:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9616
00000100:00080000:0.0:1786175882.109276:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175882.109280:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175882.109284:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145419648:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175882.109290:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109294:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175882.109299:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175882.109308:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145419776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175882.109310:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145420288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175882.109319:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175882.109323:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175882.109324:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175882.109328:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9616
00000800:00000100:0.0:1786175882.109330:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175882.109331:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109335:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175882.109340:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175882.109342:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87c700 x1872931145419776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175882.109350:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145420416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175882.109354:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145419776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175882.109360:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175882.109363:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175882.109363:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175882.109365:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175882.109367:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175882.109369:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9616
00000100:00100000:0.0:1786175882.109370:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145419776:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175882.109373:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109376:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109377:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145419904:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175882.109381:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175882.109389:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145420544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175882.109394:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175882.109399:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175882.109403:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175882.109404:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87d880 x1872931145419904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175882.109405:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175882.109409:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9616
00000100:00080000:2.0:1786175882.109412:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175882.109416:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109417:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145419904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175882.109420:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175882.109425:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175882.109429:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175882.109430:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145420672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175882.109433:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145419904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175882.109439:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145420032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175882.109457:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109467:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87f800 x1872931145420032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175882.109480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145420032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175882.109486:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175882.109488:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175882.109490:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145420032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175882.109494:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145420160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175882.109508:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109515:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87df80 x1872931145420160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175882.109527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145420160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175882.109532:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175882.109534:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175882.109536:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145420160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175882.109547:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145420288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175882.109557:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87c380 x1872931145420288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175882.109571:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145420288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175882.109576:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175882.109578:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175882.109579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145420288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175882.109583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145420416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175882.109592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109598:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87d500 x1872931145420416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175882.109609:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145420416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175882.109623:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175882.109626:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175882.109629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145420416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175882.109636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145420544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175882.109655:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109665:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87ed80 x1872931145420544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175882.109673:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145420544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175882.109678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175882.109680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175882.109682:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145420544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175882.109686:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145420672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175882.109697:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175882.109703:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175882/real 1786175882]  req@ffff89d99e87f100 x1872931145420672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175882.109710:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145420672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175882.109715:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175882.109717:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175882.109720:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145420672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175882.621048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175882.621136:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175883.133013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175883.644988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175883.645087:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175884.157007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175884.669017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175884.669119:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175885.180984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175885.693012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175885.693110:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175886.204969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175886.717081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175886.717137:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175887.229026:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175887.229036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175887.229040:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175887.229048:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175887.229062:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229075:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229084:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175887.229135:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145420800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175887.229165:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175887.229169:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175887.229171:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175887.229174:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229177:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229181:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175887.229193:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175887.229207:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145420928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175887.229228:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145420800:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175887.229247:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175887.229251:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175887.229253:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175887.229258:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229263:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229266:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175887.229272:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175887.229286:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145421056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175887.229302:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175887.229305:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175887.229307:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175887.229309:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229320:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229323:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175887.229327:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175887.229336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175887.229340:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145421184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175887.229350:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175887.229354:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175887.229356:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175887.229360:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229365:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229368:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175887.229372:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175887.229381:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145421312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175887.229390:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175887.229394:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175887.229396:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175887.229400:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2fe680 x1872931145420800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175887.229404:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229411:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229419:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175887.229428:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175887.229438:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145420800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175887.229441:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145421440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175887.229469:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175887.229470:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175887.229478:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175887.229482:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175887.229484:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175887.229491:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145420800:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175887.229492:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229499:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229504:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175887.229509:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175887.229518:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145421568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175887.229529:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175887.229530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145420928:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175887.229537:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175887.229541:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175887.229546:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229548:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229552:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175887.229557:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175887.229571:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145421696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175887.229573:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175887.229590:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175887.229594:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175887.229596:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175887.229602:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2fdf80 x1872931145420928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175887.229603:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9621
00000100:00080000:1.0:1786175887.229609:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175887.229615:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175887.229624:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175887.229638:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145421824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175887.229645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145420928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175887.229663:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175887.229669:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175887.229677:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145420928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175887.229687:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145421056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175887.229726:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175887.229740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2fc700 x1872931145421056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175887.229751:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145421056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175887.229759:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175887.229762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175887.229765:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145421056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175887.229771:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145421184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175887.229788:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175887.229797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2fce00 x1872931145421184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175887.229807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145421184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175887.229814:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175887.229816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175887.229818:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145421184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175887.229823:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145421312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175887.229837:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175887.229845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2fd880 x1872931145421312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175887.229854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145421312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175887.229861:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175887.229863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175887.229866:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145421312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175887.229870:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145421440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175887.229884:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175887.229891:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2ff480 x1872931145421440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175887.229925:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145421440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175887.229932:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175887.229935:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175887.229938:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145421440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175887.229959:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145421568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175887.229976:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175887.229985:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2fdc00 x1872931145421568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175887.229995:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145421568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175887.230003:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175887.230006:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175887.230009:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145421568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175887.230013:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145421696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175887.230027:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175887.230034:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2fe680 x1872931145421696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175887.230049:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145421696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175887.230061:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175887.230065:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175887.230069:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145421696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175887.230077:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145421824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175887.230103:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175887.230118:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175887/real 1786175887]  req@ffff89d9ba2fe300 x1872931145421824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175887.230129:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145421824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175887.230137:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175887.230139:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175887.230143:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145421824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175887.741070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175887.741142:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175888.253045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175888.765021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175888.765085:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175889.276951:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175889.788994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175889.789052:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175890.301006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175890.813026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175890.813111:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175891.325018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175891.837006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175891.837115:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175892.348982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175892.348992:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175892.349000:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175892.349004:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175892.349015:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00080000:3.0:1786175892.349025:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175892.349045:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175892.349083:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145421952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175892.349105:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175892.349108:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175892.349109:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175892.349112:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00080000:3.0:1786175892.349115:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175892.349119:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175892.349127:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175892.349138:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145421952:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175892.349139:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145422080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175892.349157:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175892.349159:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175892.349173:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175892.349178:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00080000:3.0:1786175892.349181:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175892.349185:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175892.349189:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175892.349200:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145422208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175892.349206:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175892.349209:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:0.0:1786175892.349213:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175892.349213:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175892.349220:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00080000:3.0:1786175892.349223:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175892.349226:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175892.349230:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175892.349239:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145422336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175892.349246:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175892.349248:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175892.349249:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175892.349252:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00080000:3.0:1786175892.349255:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175892.349260:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe67800 x1872931145421952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175892.349261:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175892.349268:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175892.349283:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145422464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175892.349287:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145421952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175892.349305:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175892.349308:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175892.349309:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175892.349310:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175892.349316:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175892.349319:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00080000:3.0:1786175892.349322:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175892.349323:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145421952:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175892.349329:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175892.349333:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175892.349340:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145422592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175892.349347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145422080:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175892.349351:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175892.349355:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175892.349357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175892.349361:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00080000:3.0:1786175892.349365:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175892.349369:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175892.349372:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175892.349378:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175892.349385:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe64380 x1872931145422080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175892.349389:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145422720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175892.349416:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145422080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175892.349431:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175892.349434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175892.349435:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175892.349438:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175892.349442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175892.349446:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00100000:0.0:1786175892.349448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145422080:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175892.349450:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175892.349457:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175892.349459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145422208:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786175892.349462:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175892.349475:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145422848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175892.349481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175892.349488:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175892.349491:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175892.349493:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe66300 x1872931145422208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175892.349494:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175892.349503:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9626
00000100:00080000:3.0:1786175892.349508:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175892.349512:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175892.349515:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145422208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175892.349518:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175892.349528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175892.349533:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175892.349533:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145422976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175892.349537:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145422208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175892.349548:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145422336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175892.349566:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175892.349573:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe64700 x1872931145422336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175892.349581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145422336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175892.349596:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175892.349597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175892.349599:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145422336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175892.349603:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145422464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175892.349613:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175892.349619:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe66d80 x1872931145422464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175892.349626:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145422464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175892.349631:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175892.349633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175892.349634:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145422464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175892.349645:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145422592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175892.349654:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175892.349660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe65f80 x1872931145422592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175892.349667:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145422592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175892.349672:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175892.349674:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175892.349676:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145422592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175892.349679:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145422720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175892.349689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175892.349695:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe67b80 x1872931145422720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175892.349706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145422720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175892.349711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175892.349713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175892.349715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145422720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175892.349718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145422848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175892.349727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175892.349732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe65180 x1872931145422848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175892.349739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145422848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175892.349744:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175892.349745:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175892.349747:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145422848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175892.349750:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145422976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175892.349759:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175892.349765:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175892/real 1786175892]  req@ffff89d99fe67800 x1872931145422976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175892.349772:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145422976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175892.349781:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175892.349783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175892.349785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145422976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175892.861082:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175892.861218:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175893.373126:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175893.884984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175893.885040:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175894.396984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175894.909021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175894.909115:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175895.421014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175895.932995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175895.933081:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175896.445006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175896.957038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175896.957197:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175897.469026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175897.469061:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175897.469070:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175897.469075:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469088:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:0.0:1786175897.469100:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175897.469109:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175897.469185:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145423104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175897.469219:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175897.469225:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175897.469228:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469234:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:0.0:1786175897.469240:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175897.469250:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175897.469250:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145423104:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786175897.469264:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175897.469282:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145423232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175897.469294:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175897.469297:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175897.469299:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469302:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:0.0:1786175897.469314:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175897.469321:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786175897.469321:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786175897.469330:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175897.469341:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145423360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175897.469349:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175897.469352:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175897.469354:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469358:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:0.0:1786175897.469362:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175897.469366:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175897.469371:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f2680 x1872931145423104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175897.469373:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175897.469389:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145423488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175897.469396:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145423104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175897.469401:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175897.469410:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175897.469414:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469421:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:3.0:1786175897.469422:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175897.469430:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175897.469433:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175897.469438:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175897.469443:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145423104:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786175897.469445:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175897.469460:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145423616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175897.469468:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175897.469470:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175897.469472:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469475:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:0.0:1786175897.469478:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175897.469483:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145423232:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175897.469485:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175897.469491:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175897.469504:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145423744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175897.469512:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175897.469515:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175897.469517:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469520:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:0.0:1786175897.469524:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175897.469529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175897.469543:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175897.469547:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175897.469555:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145423872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175897.469575:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f1500 x1872931145423232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175897.469579:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175897.469590:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175897.469594:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469612:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:0.0:1786175897.469615:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175897.469619:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145423232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175897.469622:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175897.469630:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786175897.469636:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175897.469642:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175897.469644:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145424000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175897.469650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145423232:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175897.469666:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175897.469666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145423360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175897.469677:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175897.469680:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175897.469685:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9631
00000100:00080000:0.0:1786175897.469688:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175897.469691:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175897.469696:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786175897.469703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175897.469708:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145424128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175897.469717:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f0700 x1872931145423360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175897.469737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145423360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175897.469745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175897.469748:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175897.469750:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145423360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175897.469755:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145423488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175897.469769:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175897.469777:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f2d80 x1872931145423488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175897.469786:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145423488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175897.469792:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175897.469795:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175897.469799:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145423488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175897.469807:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145423616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175897.469830:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175897.469844:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f2a00 x1872931145423616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175897.469861:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145423616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175897.469875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175897.469878:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175897.469880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145423616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175897.469935:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145423744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175897.469963:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175897.469979:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f3480 x1872931145423744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175897.469990:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145423744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175897.469997:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175897.470000:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175897.470002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145423744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175897.470007:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145423872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175897.470032:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175897.470041:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f3100 x1872931145423872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175897.470050:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145423872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175897.470056:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175897.470058:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175897.470061:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145423872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175897.470065:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145424000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175897.470076:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175897.470083:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f0e00 x1872931145424000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175897.470091:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145424000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175897.470098:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175897.470100:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175897.470102:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145424000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175897.470106:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145424128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175897.470140:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175897.470149:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175897/real 1786175897]  req@ffff89d9870f1880 x1872931145424128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175897.470158:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145424128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175897.470176:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175897.470179:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175897.470181:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145424128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175897.981032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175897.981096:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175898.493040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175899.005037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175899.005166:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175899.517038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175900.028972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175900.029034:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175900.540991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175901.052999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175901.053073:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175901.565035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175902.077045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175902.077100:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175902.588969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175902.589030:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175902.589036:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175902.589041:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175902.589049:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9636
00000100:00080000:0.0:1786175902.589059:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175902.589096:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175902.589134:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145424256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175902.589166:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175902.589170:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175902.589172:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175902.589175:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9636
00000100:00080000:0.0:1786175902.589179:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175902.589182:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175902.589191:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175902.589204:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145424384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175902.589219:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175902.589223:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175902.589226:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786175902.589233:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145424256:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175902.589237:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9636
00000100:00080000:0.0:1786175902.589247:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175902.589253:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175902.589262:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175902.589283:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145424512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175902.589299:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175902.589305:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:3.0:1786175902.589306:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175902.589309:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175902.589319:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9636
00000100:00080000:0.0:1786175902.589324:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175902.589329:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175902.589335:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175902.589350:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145424640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175902.589359:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175902.589364:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f1180 x1872931145424256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175902.589365:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175902.589370:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175902.589380:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9636
00000100:00080000:0.0:1786175902.589386:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175902.589389:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175902.589395:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145424256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175902.589397:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175902.589413:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145424768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175902.589413:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175902.589422:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175902.589430:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145424256:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175902.589444:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175902.589445:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145424384:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175902.589457:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175902.589461:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175902.589470:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9636
00000800:00000100:3.0:1786175902.589476:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175902.589477:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175902.589488:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175902.589492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f0a80 x1872931145424384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175902.589498:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175902.589509:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145424384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175902.589519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786175902.589524:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145424896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175902.589528:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175902.589540:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145424384:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175902.589549:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175902.589558:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175902.589563:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175902.589569:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9636
00000100:00080000:0.0:1786175902.589573:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175902.589578:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175902.589583:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175902.589596:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145424512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175902.589600:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145425024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175902.589619:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175902.589623:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175902.589626:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786175902.589631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175902.589637:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9636
00000100:00080000:0.0:1786175902.589645:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786175902.589650:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f3b80 x1872931145424512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175902.589655:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175902.589670:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175902.589674:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145424512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175902.589685:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175902.589688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175902.589695:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145425152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175902.589696:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145424512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175902.589709:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175902.589717:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786175902.589720:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145424640:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786175902.589722:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175902.589732:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9636
00000100:00080000:0.0:1786175902.589739:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786175902.589748:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175902.589749:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175902.589757:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175902.589772:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f1880 x1872931145424640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175902.589779:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145425280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786175902.589793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145424640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175902.589808:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175902.589812:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175902.589816:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145424640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175902.589822:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145424768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175902.589845:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175902.589853:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f0e00 x1872931145424768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175902.589863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145424768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175902.589872:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175902.589875:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175902.589877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145424768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175902.589884:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145424896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175902.589955:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175902.589974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f3100 x1872931145424896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175902.589994:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145424896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175902.590006:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175902.590012:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175902.590018:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145424896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175902.590055:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145425024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786175902.590104:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175902.590122:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f3480 x1872931145425024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175902.590138:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145425024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175902.590147:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175902.590150:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175902.590153:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145425024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175902.590163:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145425152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175902.590179:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175902.590264:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f2a00 x1872931145425152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175902.590276:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145425152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175902.590283:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175902.590285:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175902.590288:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145425152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175902.590293:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145425280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786175902.590421:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175902.590434:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175902/real 1786175902]  req@ffff89d9870f2d80 x1872931145425280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175902.590445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145425280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175902.590454:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175902.590458:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786175902.590462:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145425280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175903.100994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175903.101070:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175903.612992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175904.125029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175904.125121:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175904.636990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175905.149010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175905.149090:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175905.660997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175906.173094:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175906.173145:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175906.684972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175907.197002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175907.197113:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175907.708991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175907.709070:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175907.709084:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175907.709090:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709103:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709117:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175907.709127:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175907.709180:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145425408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175907.709211:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175907.709215:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175907.709216:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709219:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709222:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175907.709230:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175907.709241:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175907.709252:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145425536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175907.709260:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145425408:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175907.709262:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175907.709268:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175907.709270:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709274:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709277:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175907.709280:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175907.709285:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175907.709300:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145425664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175907.709311:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175907.709315:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175907.709317:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709321:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709326:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175907.709338:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175907.709342:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175907.709348:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175907.709359:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145425792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175907.709366:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175907.709369:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175907.709371:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709374:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709387:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175907.709390:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175907.709394:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175907.709401:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145425920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175907.709408:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe66680 x1872931145425408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175907.709409:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175907.709418:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175907.709421:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709430:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709435:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175907.709438:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175907.709443:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145425408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175907.709447:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175907.709457:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786175907.709459:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145426048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175907.709464:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175907.709482:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175907.709483:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145425408:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175907.709491:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175907.709494:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709498:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709500:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175907.709503:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175907.709505:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175907.709513:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145426176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175907.709515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145425536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175907.709528:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175907.709531:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175907.709533:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709536:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709540:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175907.709543:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786175907.709548:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175907.709549:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175907.709560:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145426304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175907.709563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe64000 x1872931145425536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175907.709589:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175907.709593:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786175907.709595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145425536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175907.709595:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175907.709604:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9641
00000100:00080000:3.0:1786175907.709610:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175907.709612:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175907.709616:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786175907.709619:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175907.709622:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175907.709624:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145425536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175907.709634:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145425664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175907.709634:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145426432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175907.709665:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175907.709673:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe67100 x1872931145425664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175907.709682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145425664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175907.709688:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175907.709690:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175907.709692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145425664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175907.709696:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145425792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175907.709707:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175907.709713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe66a00 x1872931145425792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175907.709721:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145425792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175907.709737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175907.709739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175907.709740:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145425792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175907.709744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145425920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175907.709754:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175907.709759:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe64a80 x1872931145425920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175907.709767:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145425920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175907.709772:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175907.709774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175907.709775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145425920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175907.709779:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145426048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175907.709788:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175907.709793:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe65500 x1872931145426048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175907.709800:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145426048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175907.709806:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175907.709808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175907.709810:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145426048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175907.709821:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145426176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175907.709831:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175907.709838:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe67480 x1872931145426176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175907.709850:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145426176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175907.709858:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175907.709862:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175907.709865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145426176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175907.709872:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145426304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175907.709893:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175907.709925:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe65880 x1872931145426304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175907.709934:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145426304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175907.709939:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175907.709941:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175907.709944:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145426304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175907.709949:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145426432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175907.709962:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175907.709969:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175907/real 1786175907]  req@ffff89d99fe66680 x1872931145426432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175907.709987:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145426432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175907.709993:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175907.709995:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175907.709996:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145426432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175908.221069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175908.221220:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175908.733049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175909.245015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175909.245080:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175909.757041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175910.269128:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175910.269171:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175910.781054:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175911.293031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175911.293106:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175911.805051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175912.317044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175912.317171:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175912.829078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175912.829125:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.829138:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175912.829145:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175912.829161:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00080000:3.0:1786175912.829177:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175912.829190:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175912.829248:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145426560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175912.829284:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.829288:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175912.829289:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175912.829294:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00080000:3.0:1786175912.829299:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175912.829303:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175912.829333:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175912.829340:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145426560:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175912.829357:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145426688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175912.829374:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.829379:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175912.829383:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175912.829390:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00080000:3.0:1786175912.829397:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175912.829402:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175912.829409:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786175912.829421:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175912.829428:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145426816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175912.829444:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.829449:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175912.829451:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175912.829457:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00080000:3.0:1786175912.829480:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175912.829487:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe67800 x1872931145426560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175912.829495:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175912.829524:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175912.829534:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145426560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175912.829555:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175912.829560:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175912.829564:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145426560:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175912.829592:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145426944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175912.829605:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145426688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175912.829613:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.829617:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175912.829619:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175912.829624:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00080000:3.0:1786175912.829628:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175912.829632:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175912.829637:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175912.829651:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145427072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175912.829662:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175912.829671:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.829677:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175912.829679:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175912.829685:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00080000:3.0:1786175912.829689:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175912.829694:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175912.829700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe65180 x1872931145426688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175912.829702:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175912.829718:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145427200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175912.829735:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.829749:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175912.829756:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175912.829759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145426688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175912.829765:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00080000:3.0:1786175912.829771:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175912.829783:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175912.829798:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175912.829828:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145427328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175912.829845:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175912.829846:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.829868:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175912.829884:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175912.829896:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175912.829904:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145426688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175912.829911:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00080000:3.0:1786175912.829927:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175912.829937:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145426816:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175912.829985:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175912.830007:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175912.830023:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145427456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175912.830037:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175912.830045:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175912.830050:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175912.830052:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175912.830058:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9647
00000100:00100000:0.0:1786175912.830061:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe67b80 x1872931145426816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175912.830069:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175912.830085:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175912.830086:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145426816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175912.830099:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786175912.830104:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175912.830110:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175912.830118:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145426816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175912.830118:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145427584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175912.830149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145426944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175912.830171:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175912.830184:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe65f80 x1872931145426944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175912.830194:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145426944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175912.830200:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175912.830203:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175912.830205:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145426944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175912.830210:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145427072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175912.830223:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175912.830229:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe66d80 x1872931145427072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175912.830243:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145427072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175912.830253:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175912.830257:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175912.830261:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145427072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175912.830269:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145427200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175912.830293:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175912.830307:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe64700 x1872931145427200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175912.830327:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145427200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175912.830335:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175912.830337:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175912.830340:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145427200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175912.830345:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145427328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175912.830360:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175912.830368:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe66300 x1872931145427328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175912.830377:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145427328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175912.830383:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175912.830385:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175912.830387:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145427328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175912.830391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145427456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175912.830403:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175912.830410:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe64380 x1872931145427456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175912.830418:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145427456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175912.830424:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175912.830426:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175912.830429:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145427456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175912.830443:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145427584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175912.830454:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175912.830461:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175912/real 1786175912]  req@ffff89d99fe67800 x1872931145427584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175912.830469:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145427584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175912.830485:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175912.830487:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175912.830489:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145427584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175913.341010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175913.341109:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175913.852975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175914.365059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175914.365109:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175914.877069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175915.389022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175915.389061:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175915.900979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175916.412995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175916.413059:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175916.925053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175917.437059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175917.437138:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175917.949078:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175917.949092:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175917.949098:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175917.949112:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00100000:0.0:1786175917.949124:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175917.949126:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175917.949143:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175917.949196:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145427712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175917.949230:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175917.949239:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175917.949241:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175917.949246:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00080000:2.0:1786175917.949251:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175917.949257:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175917.949285:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175917.949300:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145427712:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175917.949303:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145427840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175917.949322:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175917.949325:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175917.949338:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175917.949342:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00080000:2.0:1786175917.949347:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175917.949350:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175917.949355:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175917.949367:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145427968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175917.949377:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175917.949381:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175917.949383:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175917.949386:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00080000:2.0:1786175917.949389:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786175917.949392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175917.949398:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175917.949406:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175917.949418:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145428096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175917.949427:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175917.949431:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175917.949433:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175917.949439:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00080000:2.0:1786175917.949442:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175917.949454:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175917.949458:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175917.949468:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87dc00 x1872931145427712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175917.949472:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145428224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175917.949514:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175917.949517:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175917.949519:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175917.949525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145427712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175917.949525:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00080000:2.0:1786175917.949534:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175917.949543:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175917.949552:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786175917.949568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175917.949570:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145428352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175917.949587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175917.949588:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175917.949598:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175917.949602:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175917.949604:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145427712:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175917.949609:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00080000:2.0:1786175917.949616:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175917.949622:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175917.949627:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175917.949635:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145428480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175917.949664:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786175917.949666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145427840:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175917.949670:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175917.949676:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175917.949690:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00080000:2.0:1786175917.949694:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175917.949700:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175917.949706:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175917.949726:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145428608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175917.949739:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175917.949750:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175917.949751:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175917.949758:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175917.949768:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9652
00000100:00080000:2.0:1786175917.949775:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175917.949780:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175917.949787:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175917.949796:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87e680 x1872931145427840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175917.949809:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145428736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175917.949836:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145427840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175917.949856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175917.949861:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175917.949870:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145427840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175917.949881:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145427968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175917.949995:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175917.950023:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87ca80 x1872931145427968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175917.950046:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145427968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175917.950058:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175917.950062:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175917.950066:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145427968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175917.950074:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145428096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175917.950104:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175917.950118:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87f100 x1872931145428096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175917.950132:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145428096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175917.950142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175917.950146:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175917.950150:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145428096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175917.950157:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145428224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175917.950182:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175917.950193:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87ed80 x1872931145428224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175917.950207:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145428224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175917.950218:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175917.950224:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175917.950230:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145428224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175917.950241:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145428352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175917.950279:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175917.950302:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87d500 x1872931145428352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175917.950339:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145428352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175917.950349:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175917.950353:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175917.950357:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145428352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175917.950384:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145428480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175917.950411:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175917.950425:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87c380 x1872931145428480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175917.950450:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145428480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175917.950460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175917.950463:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175917.950467:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145428480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175917.950473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145428608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175917.950492:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175917.950502:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87df80 x1872931145428608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175917.950516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145428608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175917.950541:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175917.950547:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175917.950553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145428608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175917.950564:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145428736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175917.950600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175917.950622:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175917/real 1786175917]  req@ffff89d99e87f800 x1872931145428736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175917.950647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145428736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175917.950658:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175917.950662:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175917.950669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145428736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175918.461054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175918.461099:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175918.973043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175919.485040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175919.485146:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175919.997016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175920.509008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175920.509055:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175921.021019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175921.533042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175921.533105:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175922.045006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175922.557025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175922.557136:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175923.068992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175923.069010:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069016:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175923.069020:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069028:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069044:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069051:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175923.069085:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145428864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175923.069110:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069114:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175923.069116:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069120:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069124:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069129:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175923.069139:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175923.069153:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145428992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175923.069162:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069165:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175923.069166:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069169:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069172:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069175:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175923.069178:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175923.069186:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145429120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175923.069192:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069195:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175923.069196:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069198:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069200:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069202:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175923.069204:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175923.069211:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145429248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175923.069221:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069223:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175923.069225:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069227:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069228:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069230:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175923.069232:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175923.069237:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145429376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175923.069242:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069244:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175923.069245:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069248:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069249:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069251:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175923.069254:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175923.069259:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145429504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175923.069264:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069266:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175923.069267:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069269:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069272:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069274:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175923.069276:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175923.069281:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145429632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175923.069286:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069288:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175923.069297:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069299:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069301:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069303:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175923.069306:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175923.069313:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145429760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175923.069322:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175923.069325:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175923.069327:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175923.069331:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9657
00000100:00080000:3.0:1786175923.069334:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175923.069338:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175923.069343:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175923.069354:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145429888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175923.069601:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145428864:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175923.069690:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145428992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175923.069717:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145429120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175923.069732:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145429248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175923.069747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145429376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175923.069761:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145429504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175923.069775:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145429632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175923.069789:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145429760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175923.069801:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145429888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175923.581008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175923.581072:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175924.092970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175924.605043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175924.605140:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175925.116991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175925.629016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175925.629097:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175926.140974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:1.0:1786175926.141216:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:1.0:1786175926.141253:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1786175926.141267:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175926.141319:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:1.0:1786175926.141333:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175926.141344:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175926.141356:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175926.141368:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe66680 x1872931145428864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786175926.141369:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175926.141384:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786175926.141407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145428864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786175926.141410:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786175926.141427:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000800:00000100:1.0:1786175926.141427:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786175926.141437:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141443:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145428864:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175926.141453:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe65880 x1872931145428992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175926.141469:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145428992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175926.141477:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175926.141480:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141484:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145428992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175926.141491:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe67480 x1872931145429120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175926.141503:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145429120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175926.141512:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175926.141515:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145429120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175926.141524:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe65500 x1872931145429248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175926.141535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145429248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175926.141543:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175926.141546:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141549:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145429248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175926.141556:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe64a80 x1872931145429376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175926.141566:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145429376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175926.141573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175926.141577:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141580:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145429376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175926.141586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe66a00 x1872931145429504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175926.141612:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145429504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175926.141619:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175926.141622:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141626:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145429504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175926.141632:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe67100 x1872931145429632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175926.141644:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145429632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175926.141652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175926.141655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141658:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145429632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175926.141666:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe64000 x1872931145429760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175926.141677:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145429760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175926.141684:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175926.141688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141691:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145429760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175926.141697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175923/real 1786175926]  req@ffff89d99fe67800 x1872931145429888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175926.141709:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145429888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175926.141717:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175926.141721:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175926.141724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145429888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175926.652980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175926.653106:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175927.165011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175927.677081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175927.677219:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175928.189030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175928.189164:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175928.189175:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175928.189180:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175928.189195:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.189212:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175928.189225:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175928.189290:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145430016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175928.189336:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175928.189341:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175928.189344:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175928.189350:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.189357:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175928.189362:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175928.189375:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175928.189385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145430016:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175928.189394:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145430144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175928.189408:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175928.189413:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175928.189415:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175928.189419:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.189423:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175928.189430:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175928.189439:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175928.189457:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145430272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175928.189471:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175928.189481:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:0.0:1786175928.189482:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175928.189487:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175928.189497:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.189505:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175928.189512:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175928.189522:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175928.189543:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145430400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175928.189558:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175928.189562:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175928.189565:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175928.189579:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87d880 x1872931145430016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175928.189580:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.189596:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175928.189612:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175928.189628:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175928.189640:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145430016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175928.189651:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145430528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175928.189674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175928.189676:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175928.189689:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175928.189693:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175928.189696:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175928.189708:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145430016:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175928.189713:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.189724:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175928.189736:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175928.189745:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175928.189763:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145430144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175928.189771:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145430656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175928.189792:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175928.189797:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175928.189800:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786175928.189809:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175928.189810:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.189843:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175928.189849:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175928.189857:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175928.189879:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145430784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175928.189892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87c700 x1872931145430144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175928.189943:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145430144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175928.189954:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175928.189957:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175928.189966:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175928.189970:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175928.189977:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786175928.189981:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145430144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175928.189990:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.190000:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175928.190006:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145430272:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175928.190014:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175928.190026:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175928.190055:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145430912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786175928.190064:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175928.190075:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175928.190081:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175928.190084:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175928.190091:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9662
00000100:00080000:2.0:1786175928.190098:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786175928.190100:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87c000 x1872931145430272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175928.190110:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175928.190133:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175928.190143:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145430272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175928.190162:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145431040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175928.190172:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175928.190189:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175928.190212:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145430272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175928.190222:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145430400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175928.190255:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175928.190270:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87f800 x1872931145430400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175928.190282:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145430400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175928.190290:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175928.190294:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175928.190299:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145430400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175928.190315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145430528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175928.190351:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175928.190363:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87df80 x1872931145430528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175928.190375:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145430528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175928.190382:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175928.190385:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175928.190388:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145430528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175928.190413:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145430656:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175928.190435:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175928.190446:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87c380 x1872931145430656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175928.190460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145430656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175928.190468:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175928.190471:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175928.190486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145430656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175928.190492:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145430784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175928.190512:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175928.190524:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87d500 x1872931145430784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175928.190536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145430784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175928.190545:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175928.190548:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175928.190551:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145430784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175928.190558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145430912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175928.190578:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175928.190591:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87ed80 x1872931145430912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175928.190603:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145430912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175928.190611:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175928.190614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175928.190618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145430912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175928.190625:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145431040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175928.190644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175928.190654:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175928/real 1786175928]  req@ffff89d99e87f100 x1872931145431040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175928.190666:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145431040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175928.190675:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175928.190678:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175928.190681:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145431040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175928.701008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175928.701100:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175929.213026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175929.725045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175929.725178:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175930.237027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175930.749035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175930.749122:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175931.260995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175931.772998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175931.773121:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175932.285085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175932.797057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175932.797149:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175933.309015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175933.309043:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175933.309050:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175933.309055:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309065:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00080000:3.0:1786175933.309076:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309084:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175933.309124:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145431168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175933.309153:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175933.309157:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175933.309159:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309162:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00080000:3.0:1786175933.309166:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309169:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175933.309178:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175933.309188:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145431168:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175933.309190:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145431296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175933.309208:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175933.309210:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175933.309211:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309214:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00080000:3.0:1786175933.309216:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309218:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175933.309221:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175933.309229:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145431424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175933.309236:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175933.309238:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175933.309239:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309242:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00080000:3.0:1786175933.309245:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309247:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175933.309250:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175933.309257:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145431552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175933.309264:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786175933.309268:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175933.309268:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175933.309273:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309277:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00080000:3.0:1786175933.309281:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309284:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175933.309287:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175933.309295:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145431680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175933.309300:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175933.309302:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175933.309304:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309307:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00080000:3.0:1786175933.309310:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309313:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175933.309316:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175933.309318:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe64380 x1872931145431168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175933.309325:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145431808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175933.309345:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175933.309347:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175933.309349:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309354:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00100000:0.0:1786175933.309356:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145431168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175933.309357:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309363:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175933.309368:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175933.309379:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145431936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175933.309380:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.309391:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.309401:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145431168:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786175933.309402:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175933.309409:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175933.309411:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309414:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00080000:3.0:1786175933.309417:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309420:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175933.309423:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175933.309432:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145431296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175933.309433:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145432064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175933.309448:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175933.309450:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175933.309451:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175933.309454:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9667
00000100:00080000:3.0:1786175933.309456:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175933.309459:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175933.309462:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786175933.309468:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175933.309472:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145432192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786175933.309486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe66300 x1872931145431296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175933.309500:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145431296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175933.309517:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.309521:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.309525:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145431296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175933.309531:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145431424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175933.309553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175933.309563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe64700 x1872931145431424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175933.309576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145431424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175933.309584:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.309588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.309591:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145431424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175933.309596:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145431552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175933.309618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175933.309628:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe66d80 x1872931145431552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175933.309639:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145431552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175933.309648:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.309651:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.309654:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145431552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175933.309660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145431680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175933.309674:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175933.309682:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe65f80 x1872931145431680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175933.309700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145431680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175933.309709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.309712:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.309715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145431680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175933.309721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145431808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175933.309735:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175933.309743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe67b80 x1872931145431808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175933.309754:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145431808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175933.309762:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.309793:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.309796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145431808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175933.309802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145431936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786175933.309820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175933.309830:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe65180 x1872931145431936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175933.309841:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145431936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175933.309856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.309860:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.309863:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145431936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175933.309882:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145432064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175933.309918:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175933.309930:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe64380 x1872931145432064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175933.309942:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145432064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175933.309951:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.309955:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.309958:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145432064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175933.309964:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145432192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786175933.309980:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175933.309989:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175933/real 1786175933]  req@ffff89d99fe67800 x1872931145432192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175933.310001:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145432192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175933.310009:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175933.310012:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175933.310015:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145432192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175933.821016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175933.821108:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175934.333011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175934.845008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175934.845096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175935.356985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175935.869004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175935.869106:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175936.381070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175936.892952:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175936.893126:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175937.405026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175937.917081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175937.917238:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786175938.429003:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175938.429014:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1786175938.429019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175938.429020:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175938.429038:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9672
00000100:00080000:3.0:1786175938.429052:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175938.429074:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175938.429127:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145432320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175938.429182:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175938.429202:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175938.429212:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175938.429220:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9672
00000100:00080000:3.0:1786175938.429226:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175938.429236:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175938.429238:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145432320:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175938.429249:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175938.429274:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145432448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175938.429295:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175938.429301:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175938.429305:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175938.429312:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9672
00000800:00000100:1.0:1786175938.429319:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175938.429322:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175938.429331:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175938.429338:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175938.429362:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145432576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175938.429378:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175938.429381:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175938.429383:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175938.429388:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe64000 x1872931145432320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175938.429391:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9672
00000100:00080000:3.0:1786175938.429400:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175938.429422:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145432320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175938.429436:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175938.429442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175938.429447:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145432320:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175938.429488:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145432448:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175938.429490:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175938.429501:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175938.429522:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145432704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175938.429538:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786175938.429545:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175938.429546:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175938.429551:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175938.429559:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9672
00000100:00080000:3.0:1786175938.429565:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175938.429570:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175938.429575:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175938.429587:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe67100 x1872931145432448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175938.429592:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145432832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175938.429645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145432448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175938.429664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175938.429669:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175938.429673:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145432448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175938.429682:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145432576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175938.429712:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175938.429757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe66a00 x1872931145432576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175938.429779:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145432576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175938.429784:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175938.429795:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175938.429801:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175938.429806:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175938.429809:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9672
00000100:00080000:3.0:1786175938.429818:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175938.429820:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175938.429827:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175938.429834:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145432576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175938.429866:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145432704:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786175938.429933:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175938.429935:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175938.429955:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145432960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175938.429961:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe64a80 x1872931145432704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175938.429978:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175938.429983:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786175938.429987:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145432704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175938.429988:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175938.430000:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9672
00000100:00080000:3.0:1786175938.430009:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175938.430012:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175938.430014:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175938.430021:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786175938.430022:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175938.430029:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145432704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175938.430042:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145432832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175938.430043:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145433088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175938.430066:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175938.430070:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175938.430077:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786175938.430080:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe65500 x1872931145432832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175938.430083:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175938.430098:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9672
00000100:00100000:1.0:1786175938.430105:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145432832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175938.430108:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175938.430121:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175938.430132:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175938.430134:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175938.430140:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175938.430144:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145432832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175938.430156:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145433216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175938.430164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145432960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175938.430192:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175938.430206:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175938.430212:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175938.430214:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175938.430219:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe67480 x1872931145432960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175938.430223:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9672
00000100:00080000:3.0:1786175938.430233:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175938.430241:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175938.430245:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145432960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786175938.430253:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175938.430257:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175938.430263:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175938.430266:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145432960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175938.430273:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145433088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786175938.430281:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145433344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175938.430295:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175938.430312:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe65880 x1872931145433088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175938.430324:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145433088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175938.430332:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175938.430335:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175938.430339:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145433088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175938.430349:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145433216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175938.430363:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175938.430372:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe66680 x1872931145433216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175938.430382:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145433216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175938.430389:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175938.430391:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175938.430394:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145433216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175938.430398:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145433344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175938.430411:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175938.430418:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175938/real 1786175938]  req@ffff89d99fe65500 x1872931145433344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175938.430428:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145433344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175938.430435:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175938.430438:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175938.430440:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145433344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175938.941122:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175938.941242:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175939.453073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175939.964980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175939.965038:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175940.477029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175940.988999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175940.989052:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175941.500974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175942.012989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175942.013042:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175942.524993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175943.036978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175943.037037:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175943.549004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786175943.549012:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175943.549023:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786175943.549029:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175943.549042:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00080000:3.0:1786175943.549056:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175943.549066:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175943.549110:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145433472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175943.549149:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175943.549154:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175943.549158:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175943.549163:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00080000:3.0:1786175943.549169:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175943.549176:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175943.549189:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175943.549196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145433472:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786175943.549212:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145433600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175943.549229:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175943.549233:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175943.549236:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175943.549242:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00080000:3.0:1786175943.549247:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175943.549252:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175943.549258:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175943.549273:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145433728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175943.549287:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175943.549289:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175943.549297:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786175943.549300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175943.549307:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00080000:3.0:1786175943.549313:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175943.549319:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175943.549326:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175943.549338:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe64a80 x1872931145433472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786175943.549346:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145433856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786175943.549371:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175943.549376:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145433472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175943.549378:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786175943.549384:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175943.549399:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00080000:1.0:1786175943.549401:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175943.549406:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175943.549409:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175943.549419:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175943.549422:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145433472:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786175943.549428:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175943.549450:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145433984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175943.549466:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145433600:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175943.549468:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175943.549481:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786175943.549483:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175943.549490:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00080000:3.0:1786175943.549496:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175943.549501:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175943.549509:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175943.549516:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786175943.549533:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145434112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175943.549541:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe66a00 x1872931145433600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175943.549572:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145433600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175943.549572:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175943.549588:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786175943.549595:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175943.549596:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175943.549604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175943.549607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145433600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175943.549614:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145433728:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786175943.549622:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00080000:3.0:1786175943.549629:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175943.549636:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175943.549661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786175943.549664:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786175943.549738:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145434240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175943.549743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe67100 x1872931145433728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175943.549779:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786175943.549786:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786175943.549789:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145433728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175943.549791:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786175943.549808:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00080000:1.0:1786175943.549815:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175943.549819:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175943.549824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175943.549833:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175943.549834:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145433728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175943.549848:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145433856:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786175943.549850:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786175943.549876:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145434368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175943.549886:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786175943.549901:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175943.549906:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe64000 x1872931145433856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175943.549973:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145433856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786175943.549979:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175943.549991:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786175943.549991:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175943.550024:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786175943.550027:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9677
00000100:00100000:1.0:1786175943.550038:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145433856:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786175943.550039:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786175943.550052:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786175943.550063:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175943.550079:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145433984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786175943.550088:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145434496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175943.550120:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175943.550138:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe67800 x1872931145433984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175943.550176:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145433984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175943.550184:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175943.550188:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175943.550193:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145433984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175943.550203:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145434112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175943.550230:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175943.550247:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe64380 x1872931145434112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175943.550266:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145434112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175943.550276:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175943.550296:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175943.550299:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145434112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175943.550306:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145434240:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175943.550327:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175943.550339:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe65180 x1872931145434240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175943.550350:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145434240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175943.550365:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175943.550368:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175943.550371:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145434240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175943.550394:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145434368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175943.550410:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175943.550424:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe67b80 x1872931145434368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175943.550442:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145434368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175943.550455:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175943.550460:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175943.550465:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145434368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175943.550490:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145434496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175943.550514:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175943.550526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175943/real 1786175943]  req@ffff89d99fe65f80 x1872931145434496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175943.550537:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145434496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175943.550545:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175943.550548:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175943.550552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145434496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175944.061000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175944.061065:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175944.573067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175945.085064:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175945.085165:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175945.596961:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175946.109020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175946.109024:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175946.621061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175947.133021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175947.133127:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175947.645027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175948.157021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175948.157080:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175948.669021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175948.669028:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175948.669035:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175948.669040:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175948.669049:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669065:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175948.669072:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175948.669113:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145434624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175948.669138:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175948.669142:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175948.669145:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175948.669149:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669153:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175948.669157:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175948.669166:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175948.669180:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145434752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175948.669181:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145434624:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175948.669200:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175948.669203:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175948.669205:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175948.669221:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669224:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175948.669227:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175948.669232:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175948.669244:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145434880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175948.669253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175948.669256:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175948.669258:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175948.669260:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669264:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786175948.669269:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175948.669270:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175948.669278:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175948.669290:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145435008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175948.669298:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175948.669301:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175948.669303:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175948.669306:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669310:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175948.669314:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175948.669318:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175948.669319:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87ca80 x1872931145434624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175948.669331:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145435136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175948.669341:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175948.669346:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786175948.669347:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145434624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175948.669348:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175948.669359:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669365:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175948.669371:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175948.669375:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175948.669376:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175948.669387:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175948.669392:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145435264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175948.669396:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145434624:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175948.669412:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175948.669416:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175948.669418:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175948.669423:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669426:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175948.669430:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145434752:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175948.669432:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175948.669441:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175948.669454:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145435392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175948.669464:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786175948.669465:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786175948.669471:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175948.669474:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175948.669480:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669484:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175948.669488:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87e680 x1872931145434752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175948.669491:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175948.669499:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175948.669524:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145434752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175948.669527:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145435520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175948.669556:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175948.669558:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175948.669565:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175948.669569:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175948.669570:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175948.669579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145434752:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175948.669580:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9682
00000100:00080000:2.0:1786175948.669591:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175948.669599:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175948.669605:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175948.669606:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145434880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175948.669639:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145435648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175948.669669:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175948.669689:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87dc00 x1872931145434880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175948.669706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145434880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175948.669716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175948.669721:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175948.669726:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145434880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175948.669735:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145435008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175948.669760:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175948.669774:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87f100 x1872931145435008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175948.669785:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145435008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175948.669792:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175948.669794:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175948.669797:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145435008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175948.669802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145435136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175948.669817:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175948.669825:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87ed80 x1872931145435136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175948.669835:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145435136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175948.669841:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175948.669843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175948.669846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145435136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175948.669850:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145435264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175948.669863:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175948.669870:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87d500 x1872931145435264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175948.669879:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145435264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175948.669886:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175948.669888:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175948.669890:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145435264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175948.669932:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145435392:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175948.669948:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175948.669958:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87c380 x1872931145435392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175948.669968:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145435392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175948.669980:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175948.669983:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175948.669986:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145435392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175948.669991:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145435520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175948.670003:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175948.670011:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87df80 x1872931145435520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175948.670020:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145435520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175948.670027:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175948.670029:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175948.670031:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145435520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175948.670036:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145435648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175948.670047:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175948.670054:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175948/real 1786175948]  req@ffff89d99e87f800 x1872931145435648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175948.670063:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145435648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175948.670070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175948.670072:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175948.670075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145435648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175949.181053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175949.181129:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175949.693054:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175950.205012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175950.205074:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786175950.716950:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175951.228981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175951.229062:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175951.741013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175952.253035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175952.253080:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175952.765133:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175953.277040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175953.277090:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786175953.788980:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175953.788989:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175953.788992:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175953.789001:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00080000:2.0:1786175953.789010:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175953.789016:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786175953.789023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786175953.789050:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145435776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175953.789070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175953.789073:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175953.789074:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175953.789077:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00080000:2.0:1786175953.789080:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175953.789083:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175953.789090:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175953.789101:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145435776:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175953.789102:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145435904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175953.789116:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175953.789118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175953.789119:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175953.789123:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00080000:2.0:1786175953.789125:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175953.789128:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175953.789131:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175953.789140:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145436032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175953.789147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175953.789150:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175953.789151:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175953.789153:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00080000:2.0:1786175953.789156:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175953.789161:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175953.789162:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175953.789167:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175953.789177:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145436160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175953.789183:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175953.789186:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175953.789187:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175953.789190:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00080000:2.0:1786175953.789193:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175953.789195:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175953.789198:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175953.789200:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87c000 x1872931145435776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175953.789209:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145436288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175953.789217:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145435776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175953.789237:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175953.789240:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175953.789241:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175953.789245:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175953.789248:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175953.789252:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00100000:1.0:1786175953.789256:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145435776:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175953.789257:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175953.789265:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175953.789268:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175953.789275:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145436416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175953.789282:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145435904:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175953.789283:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175953.789288:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175953.789290:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175953.789293:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00080000:2.0:1786175953.789297:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175953.789299:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175953.789303:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786175953.789305:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175953.789317:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145436544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175953.789328:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175953.789331:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87c700 x1872931145435904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175953.789333:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175953.789337:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175953.789348:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00080000:2.0:1786175953.789355:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175953.789357:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145435904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175953.789363:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175953.789374:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175953.789374:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175953.789381:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175953.789385:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145435904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175953.789390:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145436672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175953.789393:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145436032:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175953.789406:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175953.789409:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175953.789411:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175953.789415:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9688
00000100:00080000:2.0:1786175953.789419:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175953.789423:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175953.789427:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175953.789429:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175953.789440:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145436800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175953.789448:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87d880 x1872931145436032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175953.789478:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145436032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175953.789486:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175953.789489:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175953.789492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145436032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175953.789497:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145436160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175953.789530:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175953.789537:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87f800 x1872931145436160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175953.789546:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145436160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175953.789551:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175953.789554:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175953.789556:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145436160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175953.789559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145436288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175953.789588:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175953.789596:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87df80 x1872931145436288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175953.789626:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145436288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175953.789631:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175953.789633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175953.789635:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145436288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175953.789649:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145436416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175953.789661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175953.789667:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87c380 x1872931145436416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175953.789674:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145436416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175953.789679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175953.789681:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175953.789683:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145436416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175953.789686:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145436544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175953.789696:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175953.789702:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87d500 x1872931145436544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175953.789708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145436544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175953.789718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175953.789720:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175953.789722:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145436544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175953.789725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145436672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175953.789734:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175953.789740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87ed80 x1872931145436672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175953.789747:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145436672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175953.789752:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175953.789754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175953.789756:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145436672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175953.789759:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145436800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175953.789768:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175953.789773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175953/real 1786175953]  req@ffff89d99e87f100 x1872931145436800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175953.789780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145436800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175953.789785:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175953.789787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175953.789789:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145436800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175954.301000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175954.301201:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175954.813060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175955.324989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786175955.325168:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175955.837033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175956.349031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175956.349101:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175956.860971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175957.373045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175957.373089:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175957.885021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175958.396955:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175958.397042:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175958.908967:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175958.909033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175958.909041:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175958.909046:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175958.909053:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909061:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175958.909067:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175958.909113:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145436928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175958.909142:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175958.909145:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175958.909147:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175958.909151:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909155:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175958.909158:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175958.909167:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175958.909169:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145436928:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175958.909180:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145437056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175958.909189:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175958.909192:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175958.909194:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175958.909196:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909199:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175958.909201:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175958.909204:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175958.909212:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145437184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175958.909219:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175958.909221:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175958.909223:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175958.909225:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909227:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175958.909229:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175958.909232:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175958.909236:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786175958.909243:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145437312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175958.909250:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175958.909253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175958.909254:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175958.909257:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909259:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175958.909261:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175958.909264:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175958.909271:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145437440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175958.909277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175958.909280:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786175958.909280:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f0700 x1872931145436928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175958.909284:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175958.909292:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909296:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175958.909301:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175958.909305:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175958.909311:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145436928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786175958.909315:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145437568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175958.909344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175958.909346:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175958.909348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175958.909351:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175958.909352:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175958.909357:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909361:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175958.909361:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145436928:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175958.909367:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175958.909372:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175958.909378:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145437696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175958.909384:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175958.909387:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175958.909388:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175958.909391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145437056:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175958.909395:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909399:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175958.909402:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175958.909405:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175958.909414:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145437824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175958.909423:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175958.909434:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175958.909438:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786175958.909439:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f1500 x1872931145437056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175958.909440:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175958.909460:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9693
00000100:00080000:0.0:1786175958.909463:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175958.909465:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145437056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175958.909468:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175958.909475:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175958.909479:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175958.909483:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786175958.909487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145437952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175958.909488:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145437056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175958.909506:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145437184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175958.909561:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175958.909569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f2680 x1872931145437184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175958.909577:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145437184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175958.909583:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175958.909585:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175958.909587:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145437184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175958.909591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145437312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175958.909602:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175958.909608:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f2d80 x1872931145437312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175958.909615:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145437312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175958.909620:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175958.909621:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175958.909623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145437312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175958.909627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145437440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175958.909636:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175958.909641:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f2a00 x1872931145437440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175958.909649:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145437440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175958.909654:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175958.909655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175958.909657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145437440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175958.909660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145437568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175958.909669:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175958.909675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f3480 x1872931145437568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175958.909682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145437568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175958.909687:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175958.909689:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175958.909690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145437568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175958.909693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145437696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175958.909702:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175958.909708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f3100 x1872931145437696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175958.909714:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145437696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175958.909723:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175958.909726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175958.909728:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145437696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175958.909742:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145437824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175958.909751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175958.909757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f0e00 x1872931145437824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175958.909765:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145437824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175958.909770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175958.909772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175958.909774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145437824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175958.909778:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145437952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175958.909786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175958.909792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175958/real 1786175958]  req@ffff89d9870f1880 x1872931145437952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175958.909799:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145437952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175958.909804:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175958.909805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175958.909808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145437952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175959.421009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175959.421050:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175959.932996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175960.445100:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175960.445176:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175960.957044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175961.469024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175961.469142:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175961.981043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786175962.493048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175962.493158:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175963.005021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175963.517122:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175963.517136:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175964.029000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175964.029044:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029050:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175964.029054:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029063:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029074:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029084:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175964.029128:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145438080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175964.029153:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029160:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175964.029162:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029165:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029170:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029176:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175964.029188:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175964.029207:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145438208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175964.029220:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145438080:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175964.029228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175964.029239:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029246:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029252:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029259:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175964.029267:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175964.029281:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145438336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175964.029289:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175964.029294:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029297:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029300:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029302:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175964.029307:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175964.029316:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145438464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175964.029323:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029327:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175964.029328:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029330:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029332:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029335:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175964.029338:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175964.029343:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175964.029350:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145438592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175964.029359:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029362:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175964.029363:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029366:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029369:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029373:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175964.029376:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175964.029388:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145438720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175964.029395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029398:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175964.029401:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029406:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029411:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029414:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175964.029419:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175964.029424:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87dc00 x1872931145438080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175964.029432:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145438848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175964.029487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029490:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175964.029492:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029498:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029502:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029509:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175964.029510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145438080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786175964.029520:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175964.029539:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145438976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175964.029543:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.029552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.029559:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145438080:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175964.029572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175964.029577:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175964.029582:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175964.029588:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9698
00000100:00080000:2.0:1786175964.029593:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175964.029597:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175964.029602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145438208:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786175964.029604:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175964.029633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145439104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786175964.029660:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175964.029686:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87e680 x1872931145438208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175964.029710:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145438208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175964.029726:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.029733:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.029739:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145438208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175964.029749:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145438336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175964.029776:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175964.029790:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87ca80 x1872931145438336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175964.029803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145438336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175964.029813:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.029816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.029820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145438336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175964.029827:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145438464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175964.029845:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175964.029855:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87f100 x1872931145438464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175964.029867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145438464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175964.029875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.029878:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.029881:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145438464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175964.029890:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145438592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175964.029964:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175964.029985:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87ed80 x1872931145438592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175964.030001:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145438592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175964.030010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.030013:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.030017:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145438592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175964.030024:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145438720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175964.030047:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175964.030059:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87d500 x1872931145438720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175964.030071:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145438720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175964.030080:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.030083:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.030086:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145438720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175964.030092:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145438848:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175964.030109:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175964.030119:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87c380 x1872931145438848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175964.030131:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145438848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175964.030147:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.030151:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.030154:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145438848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175964.030160:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145438976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175964.030176:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175964.030186:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87df80 x1872931145438976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175964.030198:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145438976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175964.030207:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.030210:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.030213:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145438976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175964.030243:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145439104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175964.030261:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175964.030271:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175964/real 1786175964]  req@ffff89d99e87f800 x1872931145439104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175964.030282:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145439104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175964.030292:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175964.030295:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175964.030299:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145439104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175964.541049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175964.541131:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175965.053035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175965.565066:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175965.565110:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786175966.077000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175966.589008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786175966.589083:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175967.100998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175967.612984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175967.613070:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175968.125050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175968.637032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175968.637105:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175969.149030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175969.149042:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175969.149050:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175969.149055:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149065:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149076:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175969.149085:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175969.149124:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145439232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175969.149151:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175969.149154:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175969.149156:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149160:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149164:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175969.149169:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175969.149179:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175969.149188:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145439232:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786175969.149194:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145439360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175969.149204:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175969.149207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175969.149208:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149211:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149214:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175969.149218:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175969.149222:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175969.149231:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145439488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175969.149237:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175969.149239:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175969.149241:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149243:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149245:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175969.149247:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175969.149251:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786175969.149254:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175969.149261:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145439616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175969.149268:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175969.149271:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175969.149272:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149274:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149276:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175969.149279:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175969.149282:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175969.149290:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145439744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175969.149294:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87d880 x1872931145439232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175969.149300:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175969.149307:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175969.149311:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149316:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149318:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786175969.149322:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145439232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175969.149323:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175969.149329:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786175969.149339:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786175969.149340:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145439872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175969.149347:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786175969.149354:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175969.149355:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145439232:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175969.149362:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175969.149365:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149368:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149371:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175969.149373:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175969.149375:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175969.149384:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145439360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175969.149385:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145440000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175969.149398:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175969.149400:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175969.149401:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149404:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149407:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175969.149412:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786175969.149413:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786175969.149435:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175969.149447:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87c700 x1872931145439360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175969.149448:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145440128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175969.149483:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175969.149485:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145439360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175969.149487:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175969.149491:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175969.149500:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9703
00000100:00080000:2.0:1786175969.149506:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175969.149512:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786175969.149514:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786175969.149516:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786175969.149525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175969.149530:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145440256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175969.149537:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145439360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175969.149552:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145439488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175969.149575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175969.149586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87c000 x1872931145439488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175969.149612:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145439488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175969.149618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175969.149620:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175969.149623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145439488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175969.149627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145439616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175969.149640:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175969.149646:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87f800 x1872931145439616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175969.149653:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145439616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175969.149658:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175969.149660:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175969.149661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145439616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175969.149665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145439744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175969.149675:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175969.149680:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87df80 x1872931145439744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175969.149687:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145439744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175969.149693:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175969.149695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175969.149697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145439744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175969.149700:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145439872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175969.149709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175969.149715:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87c380 x1872931145439872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175969.149721:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145439872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175969.149726:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175969.149728:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175969.149730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145439872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175969.149745:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145440000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786175969.149755:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175969.149761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87d500 x1872931145440000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175969.149768:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145440000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175969.149773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175969.149775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175969.149778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145440000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175969.149781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145440128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175969.149790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175969.149796:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87ed80 x1872931145440128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175969.149803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145440128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175969.149808:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175969.149809:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175969.149811:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145440128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175969.149814:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145440256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786175969.149824:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175969.149829:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175969/real 1786175969]  req@ffff89d99e87f100 x1872931145440256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175969.149836:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145440256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175969.149841:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175969.149843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175969.149845:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145440256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175969.660981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175969.661127:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175970.173095:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175970.685066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175970.685153:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175971.197008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175971.708996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175971.709155:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175972.221038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175972.733021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175972.733064:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175973.245019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175973.757086:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175973.757188:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175974.269066:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175974.269066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175974.269079:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175974.269087:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175974.269104:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9708
00000100:00080000:1.0:1786175974.269137:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175974.269155:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175974.269215:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145440384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175974.269263:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175974.269272:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175974.269277:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175974.269291:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9708
00000100:00080000:1.0:1786175974.269300:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175974.269308:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175974.269326:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175974.269331:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145440384:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175974.269354:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145440512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175974.269406:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175974.269412:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175974.269416:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175974.269424:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9708
00000100:00080000:1.0:1786175974.269430:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175974.269438:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175974.269450:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175974.269464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175974.269474:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145440640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175974.269505:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175974.269514:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175974.269519:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175974.269528:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9708
00000100:00080000:1.0:1786175974.269537:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175974.269546:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175974.269559:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175974.269565:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2fd180 x1872931145440384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175974.269586:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145440768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175974.269604:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145440384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175974.269606:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175974.269615:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175974.269619:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175974.269624:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175974.269626:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9708
00000100:00080000:2.0:1786175974.269632:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175974.269634:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175974.269645:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175974.269645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145440384:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786175974.269654:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175974.269672:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145440896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175974.269687:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145440512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175974.269692:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175974.269698:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175974.269702:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175974.269710:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9708
00000100:00080000:1.0:1786175974.269717:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175974.269724:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786175974.269731:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786175974.269733:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175974.269752:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145441024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175974.269754:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2fc380 x1872931145440512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175974.269772:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175974.269779:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:2.0:1786175974.269780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145440512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175974.269782:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175974.269790:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9708
00000100:00080000:1.0:1786175974.269797:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175974.269798:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175974.269806:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175974.269814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145440512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175974.269822:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175974.269831:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145440640:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786175974.269832:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175974.269851:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145441152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175974.269868:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175974.269870:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175974.269876:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175974.269880:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175974.269888:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9708
00000100:00100000:2.0:1786175974.269890:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2fd500 x1872931145440640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175974.269894:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175974.269959:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175974.269962:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145440640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786175974.269970:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175974.269979:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175974.269986:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175974.269992:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145441280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175974.269993:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145440640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175974.270006:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145440768:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786175974.270037:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175974.270043:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175974.270046:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175974.270054:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9708
00000800:00000100:2.0:1786175974.270058:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175974.270060:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175974.270067:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175974.270076:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175974.270081:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2fea00 x1872931145440768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175974.270098:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145441408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175974.270121:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145440768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175974.270136:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175974.270142:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175974.270150:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145440768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175974.270210:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145440896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175974.270256:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175974.270289:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2ff100 x1872931145440896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175974.270319:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145440896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175974.270335:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175974.270342:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175974.270350:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145440896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175974.270363:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145441024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175974.270429:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175974.270447:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2ffb80 x1872931145441024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175974.270461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145441024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175974.270480:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175974.270484:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175974.270488:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145441024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175974.270495:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145441152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175974.270515:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175974.270526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2fed80 x1872931145441152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175974.270540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145441152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175974.270549:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175974.270552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175974.270556:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145441152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175974.270563:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145441280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175974.270581:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175974.270592:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2ff800 x1872931145441280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175974.270606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145441280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175974.270615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175974.270618:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175974.270623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145441280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175974.270630:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145441408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175974.270647:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175974.270657:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175974/real 1786175974]  req@ffff89d9ba2fd180 x1872931145441408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175974.270670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145441408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786175999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175974.270681:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175974.270684:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175974.270687:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145441408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175974.781047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175974.781061:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175975.293018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175975.805043:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175975.805093:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175976.317027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175976.829073:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175976.829118:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175977.341048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175977.853059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175977.853204:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175978.365059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175978.877088:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175978.877160:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175979.389037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175979.389060:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175979.389070:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175979.389075:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175979.389087:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00080000:1.0:1786175979.389100:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389110:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175979.389156:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145441536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175979.389190:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175979.389194:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175979.389196:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175979.389200:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00080000:1.0:1786175979.389204:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389207:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175979.389218:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175979.389232:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145441664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175979.389245:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175979.389248:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175979.389250:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175979.389258:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00100000:2.0:1786175979.389262:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145441536:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175979.389263:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389273:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175979.389279:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175979.389291:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145441792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175979.389302:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175979.389306:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175979.389309:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175979.389312:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00080000:1.0:1786175979.389317:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389344:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175979.389350:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175979.389362:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145441920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175979.389373:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175979.389380:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1786175979.389381:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175979.389384:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175979.389391:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00080000:1.0:1786175979.389397:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389402:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175979.389408:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175979.389420:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145442048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175979.389430:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175979.389437:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2fe300 x1872931145441536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175979.389438:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175979.389443:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175979.389455:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00080000:1.0:1786175979.389463:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389469:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175979.389474:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175979.389478:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145441536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175979.389491:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145442176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175979.389495:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175979.389508:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175979.389513:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175979.389520:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145441536:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175979.389522:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175979.389528:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175979.389537:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145441664:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175979.389538:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00080000:1.0:1786175979.389546:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389551:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175979.389557:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175979.389573:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145442304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175979.389583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175979.389594:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175979.389598:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175979.389601:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175979.389605:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2fe680 x1872931145441664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175979.389610:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00080000:1.0:1786175979.389618:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389628:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175979.389640:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175979.389650:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145441664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175979.389654:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145442432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175979.389677:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175979.389681:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175979.389683:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175979.389692:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9713
00000100:00080000:1.0:1786175979.389701:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175979.389707:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175979.389709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786175979.389717:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175979.389718:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175979.389729:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145441664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175979.389747:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145442560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175979.389769:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145441792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175979.389813:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175979.389848:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2fdc00 x1872931145441792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175979.389869:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145441792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175979.389883:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175979.389889:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175979.389928:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145441792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175979.389950:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145441920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175979.389977:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175979.389991:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2ff480 x1872931145441920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175979.390003:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145441920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175979.390012:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175979.390015:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175979.390019:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145441920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175979.390025:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145442048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175979.390041:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175979.390050:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2fd880 x1872931145442048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175979.390061:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145442048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175979.390069:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175979.390072:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175979.390075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145442048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175979.390080:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145442176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175979.390095:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175979.390104:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2fce00 x1872931145442176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175979.390115:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145442176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175979.390124:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175979.390127:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175979.390130:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145442176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175979.390135:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145442304:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175979.390150:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175979.390158:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2fc700 x1872931145442304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175979.390170:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145442304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175979.390178:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175979.390180:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175979.390183:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145442304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175979.390188:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145442432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175979.390202:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175979.390210:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2fdf80 x1872931145442432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175979.390221:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145442432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175979.390229:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175979.390232:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175979.390236:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145442432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175979.390259:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145442560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175979.390275:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175979.390284:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175979/real 1786175979]  req@ffff89d9ba2fd180 x1872931145442560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175979.390296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145442560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175979.390304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175979.390307:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175979.390309:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145442560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175979.901088:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175979.901277:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175980.412997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175980.925066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175980.925153:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175981.436995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786175981.949062:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175981.949101:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786175982.461024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175982.973043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175982.973140:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175983.485010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175983.997037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175983.997160:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786175984.508957:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175984.508985:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175984.508991:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175984.508995:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509005:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00080000:1.0:1786175984.509012:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175984.509018:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175984.509050:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145442688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175984.509072:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175984.509074:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175984.509075:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509078:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00080000:1.0:1786175984.509081:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175984.509083:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175984.509091:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175984.509103:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145442816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175984.509103:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145442688:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175984.509117:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175984.509119:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175984.509120:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509123:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00080000:1.0:1786175984.509125:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175984.509127:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175984.509131:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175984.509139:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145442944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175984.509167:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175984.509172:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175984.509174:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509178:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00080000:1.0:1786175984.509185:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175984.509193:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175984.509201:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175984.509211:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175984.509237:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145443072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175984.509243:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175984.509246:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175984.509248:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509251:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00080000:1.0:1786175984.509254:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786175984.509258:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2ff800 x1872931145442688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175984.509260:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175984.509267:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175984.509292:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145443200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175984.509301:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175984.509305:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1786175984.509305:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145442688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175984.509309:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509318:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00080000:1.0:1786175984.509323:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175984.509326:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175984.509327:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175984.509334:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786175984.509336:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786175984.509342:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145443328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175984.509354:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175984.509356:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145442688:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175984.509357:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175984.509361:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509367:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00080000:1.0:1786175984.509370:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175984.509372:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175984.509375:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175984.509381:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145443456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175984.509388:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175984.509389:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145442816:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175984.509396:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175984.509398:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509402:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00080000:1.0:1786175984.509405:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175984.509407:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175984.509411:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175984.509420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175984.509424:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145443584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175984.509435:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2fed80 x1872931145442816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175984.509439:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175984.509447:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175984.509450:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175984.509456:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9718
00000100:00100000:2.0:1786175984.509459:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145442816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175984.509461:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175984.509469:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175984.509474:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786175984.509475:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786175984.509479:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175984.509484:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145442816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175984.509487:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145443712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175984.509493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145442944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175984.509517:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175984.509527:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2ffb80 x1872931145442944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175984.509536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145442944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175984.509542:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175984.509544:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175984.509546:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145442944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175984.509550:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145443072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175984.509561:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175984.509567:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2ff100 x1872931145443072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175984.509575:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145443072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175984.509580:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175984.509581:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175984.509583:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145443072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175984.509587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145443200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175984.509597:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175984.509602:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2fea00 x1872931145443200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175984.509610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145443200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175984.509615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175984.509616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175984.509618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145443200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175984.509622:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145443328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175984.509631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175984.509636:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2fd500 x1872931145443328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175984.509643:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145443328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175984.509648:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175984.509650:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175984.509653:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145443328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175984.509665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145443456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175984.509675:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175984.509681:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2fc380 x1872931145443456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175984.509688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145443456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175984.509694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175984.509695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175984.509697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145443456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175984.509701:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145443584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175984.509712:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175984.509717:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2ff800 x1872931145443584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175984.509724:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145443584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175984.509731:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175984.509734:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175984.509738:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145443584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175984.509744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145443712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175984.509764:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175984.509775:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175984/real 1786175984]  req@ffff89d9ba2fd180 x1872931145443712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175984.509788:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145443712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175984.509794:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175984.509796:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175984.509798:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145443712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175985.021056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175985.021196:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175985.533092:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175986.045043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175986.045227:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175986.557038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175987.069015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175987.069151:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786175987.581038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175988.093013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175988.093134:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175988.605089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175989.117049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175989.117171:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175989.629058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786175989.629162:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175989.629176:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786175989.629183:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175989.629201:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.629246:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.629259:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175989.629327:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145443840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175989.629378:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175989.629384:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175989.629387:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175989.629392:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.629397:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.629404:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175989.629420:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175989.629439:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145443968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175989.629456:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175989.629461:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175989.629470:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786175989.629473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145443840:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786175989.629481:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.629496:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.629505:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175989.629511:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175989.629532:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145444096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175989.629557:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175989.629562:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175989.629565:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175989.629573:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.629578:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.629582:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175989.629589:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175989.629605:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145444224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175989.629617:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175989.629622:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786175989.629625:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175989.629629:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.629633:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.629637:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175989.629644:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175989.629659:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145444352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175989.629671:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175989.629676:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786175989.629679:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175989.629684:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.629689:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.629697:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175989.629705:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175989.629728:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145444480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175989.629730:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145443968:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175989.629777:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175989.629783:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786175989.629787:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175989.629793:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.629797:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.629803:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175989.629812:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175989.629832:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145444608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175989.629844:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786175989.629851:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145444096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786175989.629854:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786175989.629862:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175989.629876:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.629882:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.629888:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175989.629947:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175989.629954:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145444224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175989.629974:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145444736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175989.629991:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175989.630001:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786175989.630003:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145444352:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786175989.630007:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786175989.630029:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9723
00000100:00080000:2.0:1786175989.630042:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175989.630050:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786175989.630059:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175989.630068:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145444480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175989.630080:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145444864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786175989.630108:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145444608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786175989.630141:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145444736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786175989.630167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145444864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175990.141018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175990.141167:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175990.653140:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175991.165063:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175991.165158:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175991.677184:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175992.189037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175992.189167:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175992.701439:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:1.0:1786175992.701578:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:1.0:1786175992.701651:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1786175992.701669:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175992.701728:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:1.0:1786175992.701742:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175992.701751:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175992.701772:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175992.701780:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175992.701788:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175992.701796:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786175992.701805:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786175992.701861:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87f800 x1872931145444864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702024:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145444864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702059:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702069:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702086:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145444864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175992.702105:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87d500 x1872931145444480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702129:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145444480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702145:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702151:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702158:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145444480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175992.702170:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87c380 x1872931145444608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702216:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145444608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702231:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702238:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702244:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145444608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175992.702256:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87df80 x1872931145444736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702280:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145444736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702293:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702299:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702305:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145444736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175992.702316:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87e680 x1872931145443968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702335:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145443968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702348:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702354:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702360:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145443968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175992.702371:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87dc00 x1872931145444096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702392:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145444096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702406:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702411:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702428:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145444096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175992.702440:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87f100 x1872931145444224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145444224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702492:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702498:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702503:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145444224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175992.702513:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87ed80 x1872931145444352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702532:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145444352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702549:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702554:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145444352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175992.702563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175989/real 1786175992]  req@ffff89d99e87ca80 x1872931145443840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175992.702580:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145443840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175992.702591:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175992.702596:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175992.702601:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145443840:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786175993.213050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175993.213173:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175993.725127:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175994.237078:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175994.237247:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786175994.749155:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786175994.749161:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786175994.749204:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786175994.749215:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175994.749251:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00080000:1.0:1786175994.749280:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.749295:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786175994.749364:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145444992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175994.749410:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175994.749419:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175994.749423:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175994.749432:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00080000:1.0:1786175994.749442:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.749453:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175994.749477:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175994.749502:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145444992:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786175994.749514:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145445120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175994.749547:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175994.749554:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175994.749559:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175994.749570:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00080000:1.0:1786175994.749577:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.749586:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175994.749618:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786175994.749633:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175994.749655:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145445248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175994.749680:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175994.749688:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175994.749692:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175994.749703:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00100000:2.0:1786175994.749714:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2fdf80 x1872931145444992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175994.749719:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.749743:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175994.749768:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175994.749793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145444992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786175994.749805:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145445376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175994.749849:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786175994.749856:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786175994.749868:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175994.749871:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786175994.749887:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145444992:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786175994.749948:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175994.749963:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00080000:1.0:1786175994.749972:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.749979:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175994.749990:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786175994.750018:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145445504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786175994.750040:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175994.750048:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786175994.750053:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175994.750065:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145445120:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175994.750073:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00080000:1.0:1786175994.750093:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.750106:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175994.750117:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786175994.750147:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145445632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175994.750161:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786175994.750224:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175994.750232:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786175994.750239:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175994.750252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2fc700 x1872931145445120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175994.750253:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00080000:1.0:1786175994.750270:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.750289:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175994.750309:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175994.750319:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145445120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175994.750344:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175994.750347:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145445760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175994.750364:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786175994.750397:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175994.750411:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145445120:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175994.750412:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786175994.750421:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175994.750442:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00100000:2.0:1786175994.750446:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145445248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786175994.750464:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.750482:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175994.750494:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786175994.750515:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786175994.750527:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145445888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175994.750556:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2fce00 x1872931145445248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786175994.750557:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786175994.750575:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786175994.750583:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786175994.750614:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9728
00000100:00080000:1.0:1786175994.750633:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786175994.750650:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786175994.750661:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175994.750667:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145445248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175994.750691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786175994.750695:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145446016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175994.750708:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175994.750736:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145445248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175994.750762:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145445376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175994.750820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175994.750849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2fd880 x1872931145445376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175994.750875:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145445376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175994.750890:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175994.750960:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175994.750970:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145445376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175994.750987:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145445504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175994.751034:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175994.751072:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2ff480 x1872931145445504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175994.751098:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145445504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175994.751137:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175994.751145:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175994.751152:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145445504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175994.751241:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145445632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175994.751284:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175994.751306:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2fdc00 x1872931145445632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175994.751330:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145445632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175994.751346:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175994.751352:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175994.751359:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145445632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175994.751372:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145445760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175994.751412:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175994.751434:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2fe680 x1872931145445760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175994.751457:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145445760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175994.751474:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175994.751480:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175994.751488:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145445760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175994.751501:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145445888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175994.751540:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175994.751563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2fe300 x1872931145445888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175994.751588:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145445888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175994.751605:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175994.751612:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175994.751618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145445888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175994.751632:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145446016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175994.751671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175994.751695:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175994/real 1786175994]  req@ffff89d9ba2fdf80 x1872931145446016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175994.751720:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145446016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175994.751731:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175994.751735:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175994.751739:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145446016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786175995.260991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175995.261077:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175995.773139:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175996.285032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175996.285116:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175996.797047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175997.309033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175997.309132:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175997.821033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175998.333069:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175998.333185:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175998.844981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786175999.357110:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786175999.357190:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786175999.869046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786175999.869102:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175999.869112:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786175999.869119:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175999.869174:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.869186:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175999.869196:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786175999.869243:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145446144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175999.869288:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175999.869293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175999.869296:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175999.869303:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.869310:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175999.869317:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175999.869334:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175999.869362:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145446272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175999.869379:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145446144:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175999.869392:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175999.869402:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175999.869406:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175999.869414:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.869421:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175999.869427:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175999.869436:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786175999.869456:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145446400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175999.869470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175999.869475:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175999.869482:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786175999.869484:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175999.869491:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.869501:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175999.869507:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175999.869517:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175999.869543:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145446528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786175999.869563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175999.869567:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f3b80 x1872931145446144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175999.869573:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175999.869582:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175999.869602:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.869615:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175999.869622:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786175999.869630:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145446144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786175999.869634:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175999.869659:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145446656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786175999.869663:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175999.869682:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786175999.869686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175999.869693:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145446144:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786175999.869696:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786175999.869704:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175999.869713:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.869719:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786175999.869723:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175999.869728:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175999.869739:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145446272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175999.869751:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145446784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786175999.869786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175999.869807:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f0a80 x1872931145446272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175999.869809:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175999.869832:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786175999.869838:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786175999.869846:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145446272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175999.869853:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.869867:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175999.869872:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175999.869876:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175999.869884:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786175999.869889:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786175999.869892:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145446272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175999.869963:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145446912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175999.869972:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145446400:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786175999.869992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786175999.869998:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786175999.870002:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175999.870011:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.870019:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786175999.870026:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786175999.870032:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786175999.870042:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786175999.870061:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145447040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175999.870070:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f1180 x1872931145446400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175999.870111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786175999.870119:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145446400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786175999.870146:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786175999.870155:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786175999.870173:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9734
00000100:00080000:0.0:1786175999.870186:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786175999.870190:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786175999.870197:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786175999.870207:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786175999.870210:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786175999.870221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145446400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786175999.870234:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145447168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786175999.870245:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145446528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175999.870304:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175999.870328:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f1880 x1872931145446528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175999.870354:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145446528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175999.870373:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175999.870380:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175999.870387:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145446528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175999.870399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145446656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175999.870432:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175999.870447:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f0e00 x1872931145446656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175999.870462:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145446656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175999.870472:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175999.870476:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175999.870480:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145446656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175999.870505:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145446784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175999.870526:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175999.870539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f3100 x1872931145446784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175999.870553:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145446784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175999.870568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175999.870574:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175999.870580:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145446784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175999.870591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145446912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786175999.870628:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175999.870651:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f3480 x1872931145446912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175999.870675:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145446912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175999.870686:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175999.870690:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175999.870694:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145446912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786175999.870702:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145447040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175999.870728:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175999.870742:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f2a00 x1872931145447040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175999.870757:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145447040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175999.870767:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175999.870770:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175999.870774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145447040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786175999.870781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145447168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786175999.870799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786175999.870809:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786175999/real 1786175999]  req@ffff89d9870f2d80 x1872931145447168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786175999.870823:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145447168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786175999.870833:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786175999.870836:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786175999.870840:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145447168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176000.381030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176000.381192:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176000.893033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786176001.405141:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176001.405221:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176001.916991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176002.429083:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176002.429152:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176002.940995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176003.453061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176003.453085:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176003.964974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176004.477006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176004.477165:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176004.988995:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176004.989004:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176004.989009:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176004.989012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176004.989024:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00080000:0.0:1786176004.989038:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176004.989048:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176004.989100:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145447296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176004.989125:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176004.989140:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176004.989141:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176004.989144:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00080000:0.0:1786176004.989147:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176004.989149:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176004.989157:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176004.989173:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145447424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176004.989182:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145447296:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176004.989202:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176004.989206:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176004.989209:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176004.989215:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00080000:0.0:1786176004.989219:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176004.989223:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176004.989227:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176004.989238:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145447552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176004.989245:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176004.989252:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176004.989256:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176004.989257:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176004.989262:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00080000:0.0:1786176004.989266:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176004.989268:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176004.989272:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176004.989281:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145447680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176004.989287:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176004.989290:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176004.989291:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176004.989296:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00100000:2.0:1786176004.989297:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f2680 x1872931145447296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176004.989299:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176004.989307:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176004.989315:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176004.989328:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145447296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176004.989329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145447808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176004.989357:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176004.989357:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176004.989363:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176004.989365:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176004.989366:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176004.989373:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00100000:2.0:1786176004.989373:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145447296:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176004.989380:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176004.989383:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176004.989387:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176004.989393:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145447936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176004.989399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145447424:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176004.989403:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176004.989407:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176004.989408:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176004.989412:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00080000:0.0:1786176004.989415:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176004.989417:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176004.989422:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176004.989422:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176004.989435:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145448064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176004.989438:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f1500 x1872931145447424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176004.989469:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145447424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176004.989470:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176004.989478:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176004.989482:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176004.989490:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176004.989491:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00080000:0.0:1786176004.989498:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176004.989499:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176004.989504:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176004.989505:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145447424:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176004.989509:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176004.989513:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145447552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176004.989519:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145448192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176004.989527:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176004.989532:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1786176004.989533:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176004.989535:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176004.989541:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9739
00000100:00080000:0.0:1786176004.989544:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176004.989546:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f0700 x1872931145447552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176004.989550:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176004.989556:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176004.989563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145447552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176004.989568:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145448320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176004.989599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176004.989604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176004.989609:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145447552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176004.989616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145447680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176004.989637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176004.989646:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f2d80 x1872931145447680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176004.989654:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145447680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176004.989659:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176004.989661:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176004.989663:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145447680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176004.989667:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145447808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176004.989678:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176004.989683:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f2a00 x1872931145447808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176004.989691:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145447808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176004.989695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176004.989697:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176004.989699:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145447808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176004.989711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145447936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176004.989721:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176004.989727:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f3480 x1872931145447936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176004.989734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145447936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176004.989739:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176004.989740:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176004.989742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145447936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176004.989745:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145448064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176004.989755:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176004.989760:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f3100 x1872931145448064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176004.989768:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145448064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176004.989772:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176004.989774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176004.989776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145448064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176004.989779:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145448192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176004.989788:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176004.989794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f0e00 x1872931145448192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176004.989801:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145448192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176004.989806:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176004.989808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176004.989809:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145448192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176004.989813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145448320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176004.989822:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176004.989827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176004/real 1786176004]  req@ffff89d9870f1880 x1872931145448320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176004.989834:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145448320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176029 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176004.989850:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176004.989851:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176004.989854:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145448320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176005.501099:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176005.501103:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176006.012990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176006.525015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176006.525153:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176007.037023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176007.549113:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176007.549220:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176008.061176:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176008.573084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176008.573150:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176009.085108:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176009.597026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176009.597088:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176010.109088:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176010.109116:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176010.109140:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176010.109144:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176010.109153:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9744
00000100:00080000:0.0:1786176010.109164:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176010.109172:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176010.109204:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145448448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176010.109230:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176010.109234:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176010.109237:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176010.109243:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9744
00000100:00080000:0.0:1786176010.109248:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176010.109253:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176010.109263:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176010.109273:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145448448:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176010.109277:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145448576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176010.109297:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176010.109300:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176010.109302:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176010.109306:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9744
00000100:00080000:0.0:1786176010.109309:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176010.109312:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176010.109316:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176010.109325:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145448704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176010.109333:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176010.109337:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176010.109338:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176010.109341:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9744
00000100:00080000:0.0:1786176010.109344:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786176010.109345:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176010.109348:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176010.109352:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176010.109361:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145448832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176010.109370:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176010.109374:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176010.109375:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176010.109378:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9744
00000100:00080000:0.0:1786176010.109381:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176010.109384:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176010.109389:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176010.109389:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f1180 x1872931145448448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176010.109398:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145448960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176010.109406:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176010.109407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145448448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176010.109409:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176010.109411:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176010.109414:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9744
00000100:00080000:0.0:1786176010.109417:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176010.109418:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176010.109421:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786176010.109422:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786176010.109426:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176010.109428:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145448448:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176010.109435:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145449088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176010.109443:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176010.109447:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176010.109449:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176010.109450:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145448576:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176010.109454:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9744
00000100:00080000:0.0:1786176010.109457:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176010.109461:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176010.109466:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176010.109473:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176010.109476:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145449216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176010.109486:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176010.109486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f0a80 x1872931145448576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176010.109490:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176010.109492:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176010.109496:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9744
00000100:00080000:0.0:1786176010.109499:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176010.109499:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145448576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176010.109503:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176010.109508:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786176010.109508:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176010.109512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176010.109515:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145448576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176010.109517:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145449344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176010.109521:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145448704:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176010.109527:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176010.109530:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176010.109532:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176010.109536:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9744
00000800:00000100:2.0:1786176010.109539:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176010.109540:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176010.109543:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176010.109548:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176010.109549:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f3b80 x1872931145448704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176010.109557:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145449472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176010.109561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145448704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176010.109570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176010.109573:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176010.109577:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145448704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176010.109584:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145448832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176010.109607:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176010.109620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f1880 x1872931145448832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176010.109631:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145448832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176010.109639:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176010.109643:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176010.109647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145448832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176010.109661:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145448960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176010.109682:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176010.109693:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f0e00 x1872931145448960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176010.109705:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145448960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176010.109742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176010.109746:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176010.109752:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145448960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176010.109759:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145449088:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176010.109781:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176010.109793:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f3100 x1872931145449088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176010.109807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145449088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176010.109816:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176010.109818:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176010.109820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145449088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176010.109834:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145449216:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176010.109850:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176010.109857:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f3480 x1872931145449216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176010.109865:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145449216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176010.109870:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176010.109880:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176010.109882:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145449216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176010.109885:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145449344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176010.109990:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176010.110005:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f2a00 x1872931145449344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176010.110019:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145449344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176010.110051:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176010.110055:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176010.110058:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145449344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176010.110075:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145449472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176010.110094:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176010.110102:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176010/real 1786176010]  req@ffff89d9870f2d80 x1872931145449472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176010.110110:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145449472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176010.110115:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176010.110117:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176010.110119:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145449472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176010.621003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176010.621157:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176011.132998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176011.645128:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176011.645235:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176012.157026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176012.668989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176012.669132:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176013.181089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176013.693022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176013.693095:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176014.205070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176014.717071:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176014.717084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786176015.229060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176015.229086:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229093:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176015.229098:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229107:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9749
00000100:00080000:2.0:1786176015.229116:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176015.229122:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176015.229181:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145449600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176015.229225:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229233:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176015.229236:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229259:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9749
00000100:00080000:2.0:1786176015.229265:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176015.229270:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176015.229280:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176015.229281:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145449600:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176015.229296:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145449728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176015.229308:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229311:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176015.229313:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229316:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9749
00000100:00080000:2.0:1786176015.229318:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176015.229321:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176015.229325:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176015.229335:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145449856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176015.229342:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229346:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176015.229348:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229351:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9749
00000100:00080000:2.0:1786176015.229354:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176015.229359:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176015.229360:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176015.229368:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176015.229378:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145449984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176015.229386:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229389:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176015.229391:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229393:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9749
00000100:00080000:2.0:1786176015.229397:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176015.229400:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176015.229404:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176015.229405:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87ca80 x1872931145449600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176015.229416:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145450112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176015.229426:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145449600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176015.229426:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229433:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176015.229435:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229439:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9749
00000100:00080000:2.0:1786176015.229444:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176015.229451:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176015.229459:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176015.229461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786176015.229468:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145450240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176015.229469:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176015.229479:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145449600:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176015.229488:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229492:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176015.229495:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229499:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9749
00000100:00080000:2.0:1786176015.229502:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176015.229504:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176015.229508:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176015.229513:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145449728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176015.229519:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145450368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176015.229529:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229532:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176015.229533:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229537:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9749
00000800:00000100:1.0:1786176015.229543:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176015.229544:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176015.229550:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176015.229555:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176015.229559:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87ed80 x1872931145449728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176015.229567:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145450496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176015.229577:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145449728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176015.229579:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176015.229587:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176015.229591:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176015.229600:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9749
00000100:00080000:1.0:1786176015.229602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176015.229604:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176015.229612:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176015.229612:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176015.229621:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176015.229623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145449728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176015.229637:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145450624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176015.229638:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145449856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176015.229666:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176015.229678:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87f100 x1872931145449856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176015.229688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145449856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176015.229694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176015.229696:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176015.229698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145449856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176015.229703:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145449984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176015.229716:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176015.229722:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87dc00 x1872931145449984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176015.229731:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145449984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176015.229737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176015.229739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176015.229741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145449984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176015.229745:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145450112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176015.229755:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176015.229761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87e680 x1872931145450112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176015.229770:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145450112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176015.229776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176015.229778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176015.229780:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145450112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176015.229784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145450240:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176015.229795:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176015.229801:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87df80 x1872931145450240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176015.229809:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145450240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176015.229815:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176015.229817:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176015.229820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145450240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176015.229834:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145450368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176015.229846:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176015.229853:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87c380 x1872931145450368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176015.229861:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145450368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176015.229873:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176015.229875:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176015.229877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145450368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176015.229881:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145450496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176015.229892:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176015.229920:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87d500 x1872931145450496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176015.229929:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145450496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176015.229936:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176015.229938:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176015.229941:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145450496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176015.229945:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145450624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176015.229960:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176015.229967:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176015/real 1786176015]  req@ffff89d99e87f800 x1872931145450624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176015.229999:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145450624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176015.230011:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176015.230014:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176015.230019:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145450624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176015.741084:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176015.741149:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176016.252990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176016.764989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176016.765051:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176017.276985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176017.789052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176017.789139:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176018.300994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176018.813041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176018.813105:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176019.325020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176019.836983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176019.837048:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176020.349013:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176020.349022:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176020.349026:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176020.349036:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00100000:1.0:1786176020.349040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176020.349050:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176020.349077:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176020.349118:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145450752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176020.349156:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176020.349158:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176020.349160:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176020.349163:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00080000:2.0:1786176020.349165:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176020.349168:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176020.349176:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176020.349187:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145450752:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176020.349189:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145450880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176020.349202:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176020.349204:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176020.349205:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176020.349207:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00080000:2.0:1786176020.349209:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176020.349212:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176020.349215:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176020.349222:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145451008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176020.349228:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176020.349231:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176020.349232:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176020.349234:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00080000:2.0:1786176020.349235:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176020.349244:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176020.349248:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176020.349255:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145451136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176020.349262:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176020.349264:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176020.349265:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176020.349268:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00080000:2.0:1786176020.349271:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176020.349273:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176020.349276:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176020.349284:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145451264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176020.349293:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176020.349294:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176020.349299:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176020.349300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176020.349304:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00080000:2.0:1786176020.349306:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176020.349309:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176020.349312:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176020.349319:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145451392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176020.349326:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176020.349330:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87c000 x1872931145450752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176020.349331:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176020.349334:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176020.349342:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00080000:2.0:1786176020.349347:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176020.349351:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176020.349354:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176020.349357:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145450752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176020.349364:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145451520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176020.349368:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176020.349375:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176020.349376:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176020.349380:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176020.349383:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176020.349384:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145450752:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176020.349389:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00080000:2.0:1786176020.349393:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176020.349395:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176020.349399:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176020.349406:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145451648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176020.349409:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145450880:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176020.349420:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176020.349424:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176020.349426:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176020.349432:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9754
00000100:00080000:2.0:1786176020.349436:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176020.349437:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176020.349445:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176020.349450:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87c700 x1872931145450880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176020.349452:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176020.349465:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145450880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176020.349472:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145451776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176020.349474:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176020.349481:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176020.349489:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145450880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176020.349499:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145451008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176020.349514:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176020.349520:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87d880 x1872931145451008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176020.349527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145451008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176020.349532:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176020.349534:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176020.349536:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145451008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176020.349540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145451136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176020.349550:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176020.349556:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87f800 x1872931145451136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176020.349563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145451136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176020.349568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176020.349570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176020.349571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145451136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176020.349575:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145451264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176020.349584:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176020.349589:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87d500 x1872931145451264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176020.349597:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145451264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176020.349602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176020.349603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176020.349605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145451264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176020.349609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145451392:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176020.349618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176020.349623:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87c380 x1872931145451392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176020.349630:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145451392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176020.349635:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176020.349636:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176020.349638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145451392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176020.349641:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145451520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176020.349650:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176020.349656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87df80 x1872931145451520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176020.349662:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145451520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176020.349671:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176020.349673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176020.349676:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145451520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176020.349689:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145451648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176020.349699:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176020.349704:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87e680 x1872931145451648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176020.349712:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145451648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176020.349717:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176020.349720:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176020.349723:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145451648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176020.349729:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145451776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176020.349746:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176020.349758:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176020/real 1786176020]  req@ffff89d99e87dc00 x1872931145451776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176020.349772:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145451776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176020.349780:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176020.349782:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176020.349785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145451776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176020.861013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176020.861096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176021.373105:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176021.885000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176021.885044:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176022.397022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176022.909074:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176022.909192:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176023.420998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176023.933026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176023.933122:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176024.445041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176024.957103:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176024.957296:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176025.469000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176025.469045:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176025.469053:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176025.469058:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176025.469068:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00080000:0.0:1786176025.469077:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176025.469084:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176025.469117:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145451904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176025.469140:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176025.469143:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176025.469144:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176025.469147:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00080000:0.0:1786176025.469150:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176025.469153:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176025.469162:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176025.469175:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145452032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176025.469176:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145451904:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176025.469190:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176025.469193:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176025.469194:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176025.469198:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00080000:0.0:1786176025.469200:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176025.469202:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176025.469206:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176025.469215:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145452160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176025.469221:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176025.469224:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176025.469225:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176025.469228:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00080000:0.0:1786176025.469231:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176025.469233:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176025.469237:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176025.469240:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176025.469248:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145452288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176025.469261:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176025.469263:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176025.469265:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176025.469268:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00080000:0.0:1786176025.469270:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176025.469273:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176025.469277:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f0700 x1872931145451904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176025.469285:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176025.469293:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145451904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176025.469299:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145452416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176025.469304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176025.469312:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176025.469318:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145451904:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176025.469321:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176025.469326:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176025.469329:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176025.469334:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00080000:0.0:1786176025.469339:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176025.469341:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145452032:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176025.469347:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176025.469354:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176025.469364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176025.469369:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145452544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176025.469376:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f1500 x1872931145452032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176025.469381:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176025.469389:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176025.469393:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176025.469399:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00100000:1.0:1786176025.469399:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145452032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176025.469404:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176025.469410:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176025.469414:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176025.469415:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176025.469421:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176025.469427:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145452672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176025.469427:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145452032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176025.469439:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145452160:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176025.469449:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176025.469451:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176025.469453:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176025.469456:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00080000:0.0:1786176025.469460:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176025.469461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176025.469465:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176025.469470:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176025.469473:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f2680 x1872931145452160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176025.469481:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145452800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176025.469486:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145452160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176025.469504:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176025.469507:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176025.469510:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176025.469512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176025.469514:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176025.469518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145452160:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176025.469521:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9759
00000100:00080000:0.0:1786176025.469525:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176025.469527:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145452288:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176025.469531:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176025.469537:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176025.469547:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145452928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176025.469552:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176025.469569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f2d80 x1872931145452288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176025.469579:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145452288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176025.469585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176025.469588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176025.469590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145452288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176025.469595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145452416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176025.469607:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176025.469612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f2a00 x1872931145452416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176025.469620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145452416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176025.469624:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176025.469626:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176025.469628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145452416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176025.469639:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145452544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176025.469649:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176025.469654:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f3480 x1872931145452544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176025.469662:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145452544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176025.469671:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176025.469674:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176025.469676:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145452544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176025.469683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145452672:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176025.469695:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176025.469700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f3100 x1872931145452672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176025.469712:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145452672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176025.469717:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176025.469718:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176025.469720:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145452672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176025.469723:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145452800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176025.469732:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176025.469737:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f0e00 x1872931145452800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176025.469744:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145452800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176025.469749:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176025.469750:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176025.469752:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145452800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176025.469755:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145452928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176025.469764:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176025.469769:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176025/real 1786176025]  req@ffff89d9870f1880 x1872931145452928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176025.469775:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145452928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176025.469784:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176025.469786:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176025.469788:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145452928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176025.981007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176025.981067:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176026.493019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176027.005049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176027.005135:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176027.517010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176028.029050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176028.029130:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176028.540988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176029.052983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176029.053051:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176029.565002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176030.076990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176030.077018:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176030.589055:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176030.589082:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176030.589085:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176030.589097:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176030.589115:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00080000:0.0:1786176030.589132:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176030.589160:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176030.589218:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145453056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176030.589255:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176030.589261:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176030.589263:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176030.589268:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00080000:0.0:1786176030.589274:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176030.589279:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176030.589291:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176030.589308:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145453184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176030.589326:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176030.589331:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176030.589333:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176030.589339:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00080000:0.0:1786176030.589345:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176030.589347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145453056:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176030.589352:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176030.589364:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176030.589380:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145453312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176030.589392:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176030.589397:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176030.589399:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176030.589403:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00080000:0.0:1786176030.589408:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176030.589412:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176030.589430:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176030.589453:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145453440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176030.589471:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176030.589477:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176030.589483:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176030.589485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176030.589499:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00080000:0.0:1786176030.589512:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176030.589521:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176030.589532:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176030.589551:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f3b80 x1872931145453056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176030.589560:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145453568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176030.589608:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145453056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176030.589619:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176030.589633:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176030.589634:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176030.589639:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176030.589645:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176030.589658:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00100000:1.0:1786176030.589660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145453056:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176030.589677:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176030.589692:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176030.589704:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176030.589720:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145453184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176030.589733:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145453696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176030.589752:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176030.589758:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176030.589765:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176030.589766:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176030.589777:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00080000:0.0:1786176030.589787:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176030.589797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f0a80 x1872931145453184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176030.589798:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176030.589814:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176030.589872:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145453184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176030.589879:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145453824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176030.589940:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176030.589954:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176030.589968:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176030.589969:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145453184:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176030.589986:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176030.589990:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176030.589992:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145453312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176030.590005:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00080000:0.0:1786176030.590017:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176030.590028:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176030.590035:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176030.590046:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176030.590058:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f1180 x1872931145453312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176030.590085:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145453952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176030.590086:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145453312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176030.590157:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176030.590162:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176030.590164:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176030.590176:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176030.590178:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145453312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176030.590182:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176030.590196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145453440:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176030.590197:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9764
00000100:00080000:0.0:1786176030.590213:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176030.590222:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176030.590232:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176030.590239:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176030.590264:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145454080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176030.590266:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f1880 x1872931145453440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176030.590333:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145453440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176030.590353:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176030.590358:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176030.590363:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145453440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176030.590370:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145453568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176030.590392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176030.590403:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f0e00 x1872931145453568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176030.590417:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145453568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176030.590434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176030.590438:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176030.590442:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145453568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176030.590464:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145453696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176030.590483:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176030.590495:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f3100 x1872931145453696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176030.590510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145453696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176030.590520:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176030.590523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176030.590528:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145453696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176030.590534:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145453824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176030.590552:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176030.590563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f3480 x1872931145453824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176030.590576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145453824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176030.590586:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176030.590589:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176030.590593:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145453824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176030.590599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145453952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176030.590617:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176030.590627:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f2a00 x1872931145453952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176030.590640:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145453952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176030.590650:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176030.590653:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176030.590657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145453952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176030.590663:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145454080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176030.590680:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176030.590690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176030/real 1786176030]  req@ffff89d9870f2d80 x1872931145454080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176030.590704:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145454080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176030.590714:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176030.590717:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176030.590721:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145454080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176031.101006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176031.101152:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176031.613133:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176032.125007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176032.125087:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176032.637108:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176033.149129:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176033.149145:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176033.661009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176034.173070:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176034.173087:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176034.685023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176035.197022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176035.197151:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176035.709059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176035.709095:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176035.709106:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176035.709112:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.709124:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.709136:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.709147:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176035.709197:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145454208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176035.709236:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176035.709241:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176035.709244:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.709250:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.709255:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.709269:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176035.709283:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176035.709305:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145454336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176035.709307:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145454208:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176035.709336:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176035.709341:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176035.709343:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.709349:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.709356:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.709363:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176035.709372:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176035.709400:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145454464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176035.709430:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176035.709442:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176035.709444:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176035.709453:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.709462:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.709471:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.709476:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176035.709484:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176035.709501:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145454592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176035.709515:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176035.709519:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176035.709539:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.709544:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.709548:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.709552:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176035.709558:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176035.709569:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145454720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176035.709581:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176035.709585:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176035.709587:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.709592:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.709596:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.709601:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176035.709606:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176035.709615:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145454848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176035.709626:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176035.709630:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176035.709633:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.709640:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.709645:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.709652:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176035.709670:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176035.709682:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145454976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176035.709694:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176035.709699:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176035.709703:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.709711:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.709719:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.709725:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176035.709732:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176035.709752:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145455104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176035.709755:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87f100 x1872931145454208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710116:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145454208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710131:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710136:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710141:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145454208:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176035.710193:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145454336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176035.710216:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176035.710221:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176035.710224:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176035.710231:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9769
00000100:00080000:2.0:1786176035.710239:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176035.710245:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176035.710258:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176035.710293:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145455232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176035.710322:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176035.710363:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87ed80 x1872931145454336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710383:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145454336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710424:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710431:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145454336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176035.710440:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145454464:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176035.710464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176035.710475:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87ca80 x1872931145454464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710487:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145454464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710495:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710498:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710501:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145454464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176035.710506:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145454592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176035.710522:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176035.710530:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87dc00 x1872931145454592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145454592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710548:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710555:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145454592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176035.710560:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145454720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176035.710574:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176035.710582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87e680 x1872931145454720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710591:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145454720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710598:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710603:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145454720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176035.710608:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145454848:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176035.710623:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176035.710631:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87df80 x1872931145454848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710640:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145454848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710647:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710650:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710653:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145454848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176035.710659:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145454976:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176035.710693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176035.710706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87c380 x1872931145454976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710721:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145454976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710731:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710734:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710738:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145454976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176035.710767:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145455104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176035.710833:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176035.710844:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87d500 x1872931145455104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145455104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710862:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710865:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710869:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145455104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176035.710875:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145455232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176035.710891:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176035.710900:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176035/real 1786176035]  req@ffff89d99e87f800 x1872931145455232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176035.710963:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145455232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176035.710975:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176035.710979:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176035.710983:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145455232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176036.221030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176036.221130:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176036.733022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176037.245002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176037.245140:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176037.757115:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176038.269064:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176038.269141:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176038.781053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176039.293023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176039.293104:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176039.805014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176040.317019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176040.317116:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786176040.829062:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176040.829076:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176040.829080:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176040.829088:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176040.829101:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829115:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829124:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176040.829185:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145455360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176040.829221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176040.829225:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176040.829227:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176040.829230:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829235:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829239:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176040.829253:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176040.829271:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145455488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176040.829283:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176040.829287:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176040.829293:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176040.829299:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145455360:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176040.829316:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829324:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829328:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176040.829334:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176040.829351:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145455616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176040.829359:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176040.829363:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176040.829365:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176040.829368:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829371:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829373:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176040.829378:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176040.829386:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145455744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176040.829400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176040.829404:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176040.829406:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176040.829409:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829413:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829423:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786176040.829425:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786176040.829437:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176040.829452:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145455872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176040.829461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176040.829465:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176040.829468:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176040.829471:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829474:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829477:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176040.829480:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176040.829492:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145456000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176040.829501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176040.829506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:2.0:1786176040.829510:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2fd180 x1872931145455360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176040.829512:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176040.829532:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829544:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829562:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176040.829569:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176040.829571:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145455360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176040.829590:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145456128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176040.829597:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176040.829609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176040.829614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176040.829622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176040.829626:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176040.829628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145455360:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176040.829638:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829645:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829648:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176040.829652:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176040.829666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145456256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176040.829674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176040.829678:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176040.829679:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176040.829683:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9775
00000100:00080000:1.0:1786176040.829686:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176040.829690:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176040.829693:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176040.829707:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145455488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176040.829708:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145456384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176040.829798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176040.829831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2ff800 x1872931145455488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176040.829848:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145455488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176040.829859:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176040.829864:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176040.829868:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145455488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176040.829876:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145455616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176040.829933:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176040.829949:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2fc380 x1872931145455616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176040.829964:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145455616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176040.829974:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176040.829978:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176040.829982:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145455616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176040.829989:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145455744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176040.830010:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176040.830021:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2fd500 x1872931145455744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176040.830034:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145455744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176040.830045:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176040.830051:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176040.830056:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145455744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176040.830068:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145455872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176040.830103:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176040.830126:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2fea00 x1872931145455872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176040.830150:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145455872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176040.830163:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176040.830167:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176040.830171:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145455872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176040.830179:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145456000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176040.830206:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176040.830236:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2ff100 x1872931145456000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176040.830247:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145456000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176040.830254:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176040.830257:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176040.830260:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145456000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176040.830265:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145456128:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176040.830282:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176040.830290:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2ffb80 x1872931145456128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176040.830301:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145456128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176040.830307:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176040.830310:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176040.830313:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145456128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176040.830319:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145456256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176040.830333:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176040.830341:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2fed80 x1872931145456256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176040.830351:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145456256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176040.830359:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176040.830361:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176040.830365:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145456256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176040.830399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145456384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176040.830431:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176040.830448:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176040/real 1786176040]  req@ffff89d9ba2fd180 x1872931145456384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176040.830462:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145456384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176040.830470:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176040.830473:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176040.830476:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145456384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176041.341056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176041.341088:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176041.853009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176042.365113:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176042.365156:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176042.877089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176043.389167:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176043.389230:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176043.901030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176044.413018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176044.413145:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176044.925061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176045.437107:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176045.437210:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176045.948984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176045.949075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949083:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176045.949087:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176045.949097:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949108:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176045.949117:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176045.949160:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145456512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176045.949192:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949195:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176045.949197:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176045.949201:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949206:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176045.949210:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176045.949236:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176045.949253:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145456640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176045.949259:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145456512:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176045.949287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949292:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176045.949294:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176045.949301:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949321:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176045.949326:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176045.949331:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176045.949335:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176045.949348:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145456768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176045.949363:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949366:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176045.949368:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176045.949372:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949375:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176045.949378:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176045.949382:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176045.949384:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f2680 x1872931145456512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176045.949413:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145456896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176045.949421:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949425:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176045.949426:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145456512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176045.949427:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176045.949435:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949440:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176045.949446:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176045.949447:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176045.949450:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176045.949455:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.949460:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145456512:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176045.949463:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145457024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176045.949472:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949474:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176045.949476:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176045.949478:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949481:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176045.949484:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176045.949487:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176045.949488:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145456640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176045.949497:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145457152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176045.949506:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949509:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176045.949511:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176045.949516:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176045.949518:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949523:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176045.949527:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176045.949532:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176045.949538:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f1500 x1872931145456640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176045.949542:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145457280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176045.949573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176045.949577:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176045.949581:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949585:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176045.949586:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145456640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176045.949590:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176045.949596:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176045.949608:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176045.949614:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145457408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176045.949615:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.949624:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145456640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176045.949654:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145456768:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176045.949663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176045.949668:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176045.949671:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176045.949693:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9780
00000100:00080000:0.0:1786176045.949705:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176045.949713:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176045.949729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176045.949735:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176045.949751:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145457536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176045.949753:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f0700 x1872931145456768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176045.949779:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145456768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176045.949791:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176045.949795:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.949799:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145456768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176045.949809:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145456896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176045.949833:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176045.949848:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f2d80 x1872931145456896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176045.949860:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145456896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176045.949869:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176045.949873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.949877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145456896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176045.949883:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145457024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176045.949901:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176045.949932:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f2a00 x1872931145457024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176045.949943:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145457024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176045.949950:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176045.949952:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.949955:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145457024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176045.949971:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145457152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176045.949985:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176045.949992:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f3480 x1872931145457152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176045.950001:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145457152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176045.950006:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176045.950008:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.950010:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145457152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176045.950013:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145457280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176045.950023:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176045.950029:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f3100 x1872931145457280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176045.950037:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145457280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176045.950047:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176045.950049:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.950051:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145457280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176045.950055:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145457408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176045.950064:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176045.950070:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f0e00 x1872931145457408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176045.950077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145457408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176045.950082:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176045.950084:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.950086:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145457408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176045.950090:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145457536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176045.950099:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176045.950105:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176045/real 1786176045]  req@ffff89d9870f1880 x1872931145457536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176045.950112:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145457536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176045.950117:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176045.950119:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176045.950121:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145457536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176046.460992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176046.461060:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176046.972997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176047.485113:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176047.485140:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786176047.996981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176048.509007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176048.509072:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176049.021042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176049.532976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176049.533060:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176050.044987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176050.556999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176050.557085:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176051.069040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176051.069092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176051.069101:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176051.069107:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176051.069121:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069133:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176051.069143:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176051.069188:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145457664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176051.069224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176051.069229:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176051.069232:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176051.069238:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069242:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176051.069246:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176051.069258:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176051.069275:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145457792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176051.069290:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145457664:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176051.069293:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176051.069308:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176051.069311:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176051.069317:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069321:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176051.069325:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176051.069343:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176051.069359:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145457920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176051.069371:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176051.069375:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176051.069377:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176051.069381:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069386:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176051.069389:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176051.069395:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176051.069405:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176051.069410:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145458048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176051.069424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176051.069429:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176051.069432:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176051.069436:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069442:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176051.069446:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176051.069451:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176051.069464:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145458176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176051.069474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176051.069482:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176051.069484:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f1180 x1872931145457664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176051.069485:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176051.069505:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069514:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176051.069523:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176051.069530:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176051.069539:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145457664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176051.069548:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145458304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176051.069569:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176051.069575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176051.069581:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176051.069585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176051.069591:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176051.069592:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145457664:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176051.069602:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069609:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176051.069614:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176051.069619:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176051.069652:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145458432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176051.069663:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145457792:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176051.069674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176051.069680:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176051.069682:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176051.069688:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069702:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176051.069709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176051.069711:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176051.069723:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176051.069738:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f0a80 x1872931145457792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176051.069745:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145458560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176051.069779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176051.069784:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145457792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176051.069786:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176051.069791:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176051.069802:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9785
00000100:00080000:0.0:1786176051.069814:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176051.069815:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176051.069824:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176051.069829:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786176051.069835:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176051.069838:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145457792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176051.069856:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145458688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176051.069857:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145457920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176051.069894:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176051.069947:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f3b80 x1872931145457920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176051.069964:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145457920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176051.069974:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176051.069980:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176051.069986:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145457920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176051.069996:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145458048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176051.070024:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176051.070037:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f1880 x1872931145458048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176051.070055:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145458048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176051.070067:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176051.070071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176051.070074:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145458048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176051.070081:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145458176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176051.070100:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176051.070110:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f0e00 x1872931145458176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176051.070123:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145458176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176051.070132:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176051.070135:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176051.070138:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145458176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176051.070144:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145458304:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176051.070161:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176051.070170:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f3100 x1872931145458304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176051.070182:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145458304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176051.070191:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176051.070194:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176051.070197:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145458304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176051.070222:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145458432:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176051.070240:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176051.070251:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f3480 x1872931145458432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176051.070272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145458432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176051.070281:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176051.070284:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176051.070287:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145458432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176051.070293:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145458560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176051.070310:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176051.070320:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f2a00 x1872931145458560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176051.070344:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145458560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176051.070353:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176051.070356:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176051.070360:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145458560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176051.070365:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145458688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176051.070390:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176051.070407:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176051/real 1786176051]  req@ffff89d9870f2d80 x1872931145458688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176051.070428:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145458688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176051.070456:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176051.070462:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176051.070468:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145458688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176051.580976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176051.581097:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176052.092974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176052.605104:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176052.605120:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176053.117078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176053.629089:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176053.629140:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176054.140979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176054.653046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176054.653239:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176055.165059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176055.677058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176055.677211:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176056.189022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189034:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176056.189040:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176056.189052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176056.189053:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00080000:0.0:1786176056.189077:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176056.189086:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176056.189123:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145458816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176056.189158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189164:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176056.189166:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176056.189171:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00080000:0.0:1786176056.189176:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176056.189181:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176056.189192:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176056.189197:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145458816:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176056.189208:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145458944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176056.189221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189224:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176056.189226:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176056.189231:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00080000:0.0:1786176056.189236:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176056.189240:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176056.189245:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176056.189274:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145459072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176056.189287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189292:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176056.189294:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176056.189299:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00080000:0.0:1786176056.189303:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176056.189308:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176056.189315:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176056.189329:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145458944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176056.189330:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145459200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176056.189345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189351:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176056.189354:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176056.189360:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00080000:0.0:1786176056.189364:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176056.189370:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176056.189371:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145459072:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176056.189391:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176056.189408:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145459328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176056.189409:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145459200:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176056.189433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189462:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176056.189465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145459328:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176056.189466:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176056.189472:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00080000:0.0:1786176056.189478:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176056.189485:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176056.189506:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176056.189530:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145459456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176056.189643:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189648:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176056.189650:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145459456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176056.189652:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176056.189657:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00080000:0.0:1786176056.189663:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176056.189669:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176056.189675:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176056.189689:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145459584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176056.189704:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176056.189711:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176056.189717:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00100000:1.0:1786176056.189720:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145459584:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176056.189722:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176056.189727:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176056.189733:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176056.189746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145459712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176056.189760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176056.189765:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176056.189767:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176056.189772:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9790
00000100:00080000:0.0:1786176056.189777:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176056.189778:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145459712:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176056.189781:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176056.189787:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176056.189799:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145459840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176056.189833:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145459840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176056.701012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176056.701121:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176057.213032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176057.725047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176057.725165:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176058.237033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176058.749026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176058.749157:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176059.261013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786176059.261232:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786176059.261285:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786176059.261305:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176059.261371:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786176059.261395:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176059.261406:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176059.261414:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176059.261422:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176059.261431:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176059.261461:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176059.261474:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176059.261488:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f1880 x1872931145459840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.261529:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145459840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.261567:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.261577:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.261584:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145459840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176059.261599:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f0e00 x1872931145459712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.261622:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145459712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.261645:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.261652:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.261657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145459712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176059.261669:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f3100 x1872931145459584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.261705:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145459584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.261728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.261735:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.261741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145459584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176059.261758:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f3480 x1872931145459456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.261781:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145459456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.261791:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.261795:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.261798:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145459456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176059.261807:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f2a00 x1872931145459328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.261823:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145459328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.261836:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.261859:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.261865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145459328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176059.261892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f2d80 x1872931145459200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.261910:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145459200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.261955:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.261960:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.261966:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145459200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176059.261977:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f1500 x1872931145458944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.261997:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145458944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.262008:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.262012:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.262018:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145458944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176059.262027:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f2680 x1872931145459072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.262043:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145459072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.262053:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.262059:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.262063:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145459072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176059.262072:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176056/real 1786176059]  req@ffff89d9870f0700 x1872931145458816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176059.262089:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145458816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176059.262099:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176059.262102:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176059.262106:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145458816:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176059.773128:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176059.773163:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176060.284972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176060.797034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176060.797116:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176061.309038:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176061.309066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176061.309067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176061.309074:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176061.309095:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.309108:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176061.309117:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176061.309159:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145459968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176061.309210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176061.309214:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176061.309216:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176061.309220:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.309224:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176061.309228:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176061.309238:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176061.309253:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145460096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176061.309286:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176061.309292:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176061.309296:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176061.309303:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.309311:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176061.309312:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145459968:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176061.309325:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176061.309336:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176061.309359:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145460224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176061.309394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176061.309400:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176061.309403:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176061.309409:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.309416:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176061.309421:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176061.309430:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176061.309435:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176061.309456:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145460352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176061.309494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176061.309498:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176061.309500:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176061.309505:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.309510:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176061.309514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f3b80 x1872931145459968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176061.309519:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176061.309572:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176061.309599:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145460480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176061.309608:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145459968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176061.309623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176061.309637:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176061.309640:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176061.309641:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176061.309656:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176061.309658:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.309671:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176061.309671:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145459968:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176061.309686:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176061.309694:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145460096:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176061.309700:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176061.309727:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145460608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176061.309746:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176061.309764:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176061.309770:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176061.309776:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f0a80 x1872931145460096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176061.309777:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176061.309795:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.309807:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176061.309818:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145460096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176061.309819:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176061.309846:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176061.309861:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176061.309868:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176061.309873:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145460736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176061.309880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145460096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176061.309900:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176061.309907:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176061.309940:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176061.309947:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.309953:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176061.309962:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176061.309969:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176061.309986:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145460864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176061.309994:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145460224:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176061.310014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176061.310022:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176061.310026:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176061.310033:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9795
00000100:00080000:0.0:1786176061.310041:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176061.310049:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176061.310053:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176061.310063:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176061.310077:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f1180 x1872931145460224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176061.310085:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145460992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176061.310115:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145460224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176061.310130:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176061.310136:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176061.310141:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145460224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176061.310150:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145460352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176061.310181:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176061.310199:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f0700 x1872931145460352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176061.310216:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145460352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176061.310227:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176061.310232:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176061.310237:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145460352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176061.310246:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145460480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176061.310273:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176061.310289:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f2680 x1872931145460480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176061.310316:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145460480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176061.310327:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176061.310332:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176061.310336:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145460480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176061.310344:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145460608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176061.310371:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176061.310387:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f1500 x1872931145460608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176061.310402:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145460608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176061.310413:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176061.310417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176061.310422:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145460608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176061.310430:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145460736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176061.310456:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176061.310471:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f2d80 x1872931145460736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176061.310486:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145460736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176061.310503:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176061.310507:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176061.310510:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145460736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176061.310558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145460864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176061.310587:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176061.310602:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f2a00 x1872931145460864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176061.310617:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145460864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176061.310628:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176061.310633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176061.310636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145460864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176061.310645:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145460992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176061.310671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176061.310686:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176061/real 1786176061]  req@ffff89d9870f3480 x1872931145460992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176061.310700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145460992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176061.310710:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176061.310714:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176061.310719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145460992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176061.821093:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176061.821185:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176062.332971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786176062.845051:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176062.845097:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786176063.356988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176063.869073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176063.869164:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176064.380993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176064.892980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176064.893179:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176065.405035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176065.917019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176065.917217:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176066.429110:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176066.429137:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176066.429165:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176066.429174:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.429192:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00080000:0.0:1786176066.429213:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176066.429227:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176066.429322:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145461120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176066.429378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176066.429384:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176066.429386:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.429392:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00080000:0.0:1786176066.429397:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176066.429403:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176066.429418:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176066.429448:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145461248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176066.429462:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176066.429466:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176066.429468:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.429474:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00080000:0.0:1786176066.429502:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176066.429508:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176066.429514:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176066.429519:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145461120:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176066.429533:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145461376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176066.429546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176066.429550:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176066.429552:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.429556:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00080000:0.0:1786176066.429560:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176066.429564:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176066.429569:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176066.429583:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145461504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176066.429594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176066.429599:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176066.429603:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.429609:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00080000:0.0:1786176066.429636:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176066.429645:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176066.429651:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176066.429662:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176066.429684:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145461632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176066.429703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176066.429709:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176066.429713:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.429722:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00100000:1.0:1786176066.429728:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f3100 x1872931145461120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176066.429729:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176066.429741:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176066.429755:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176066.429767:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145461120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176066.429775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145461760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176066.429789:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176066.429792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176066.429797:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176066.429802:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145461120:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176066.429811:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176066.429813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145461248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176066.429816:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.429835:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00080000:0.0:1786176066.429840:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176066.429845:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176066.429853:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176066.429860:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176066.429871:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145461888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176066.429881:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f0e00 x1872931145461248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176066.429941:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145461248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176066.429961:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176066.429974:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176066.429977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176066.429983:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145461248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176066.429986:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176066.429993:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.430002:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00080000:0.0:1786176066.430007:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176066.430014:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176066.430021:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176066.430030:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145461376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176066.430041:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145462016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176066.430055:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176066.430062:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176066.430064:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176066.430069:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176066.430076:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9800
00000100:00080000:0.0:1786176066.430081:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176066.430084:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f1880 x1872931145461376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176066.430089:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176066.430099:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176066.430111:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145461376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176066.430119:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145462144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176066.430161:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176066.430169:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176066.430173:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145461376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176066.430182:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145461504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176066.430207:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176066.430219:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f3480 x1872931145461504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176066.430233:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145461504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176066.430241:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176066.430243:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176066.430246:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145461504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176066.430251:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145461632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176066.430267:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176066.430289:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f2a00 x1872931145461632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176066.430301:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145461632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176066.430309:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176066.430312:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176066.430315:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145461632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176066.430321:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145461760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176066.430338:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176066.430348:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f2d80 x1872931145461760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176066.430360:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145461760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176066.430367:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176066.430370:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176066.430373:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145461760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176066.430378:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145461888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176066.430393:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176066.430402:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f1500 x1872931145461888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176066.430413:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145461888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176066.430422:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176066.430425:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176066.430428:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145461888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176066.430448:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145462016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176066.430464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176066.430474:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f2680 x1872931145462016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176066.430507:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145462016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176066.430517:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176066.430521:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176066.430524:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145462016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176066.430533:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145462144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176066.430563:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176066.430583:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176066/real 1786176066]  req@ffff89d9870f0700 x1872931145462144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176066.430602:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145462144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176066.430615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176066.430619:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176066.430625:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145462144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176066.941010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176066.941150:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176067.453029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176067.965016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176067.965108:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176068.477078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176068.989035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176068.989206:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176069.500984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176070.013065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176070.013192:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176070.525021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176071.037048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176071.037096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176071.548989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176071.549047:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176071.549058:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176071.549075:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176071.549091:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549106:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176071.549115:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176071.549176:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145462272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176071.549208:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176071.549212:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176071.549214:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176071.549218:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549222:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176071.549226:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176071.549238:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176071.549251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145462400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176071.549257:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145462272:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176071.549265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176071.549271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176071.549273:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176071.549277:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549280:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176071.549284:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176071.549290:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176071.549301:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145462528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176071.549321:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176071.549326:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176071.549329:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176071.549334:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549341:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176071.549353:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176071.549361:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176071.549373:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176071.549401:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145462656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176071.549402:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f1180 x1872931145462272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176071.549468:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176071.549473:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176071.549476:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176071.549482:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145462272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176071.549489:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549501:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176071.549506:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176071.549508:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176071.549519:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176071.549519:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176071.549533:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145462272:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176071.549540:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145462784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176071.549550:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176071.549554:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176071.549555:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176071.549560:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549566:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176071.549573:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176071.549582:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176071.549583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145462400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176071.549613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145462912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176071.549626:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176071.549643:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176071.549649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f0a80 x1872931145462400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176071.549650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176071.549654:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176071.549669:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549677:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176071.549679:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145462400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176071.549686:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176071.549706:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176071.549708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176071.549713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176071.549717:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145462400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176071.549725:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145463040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176071.549733:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145462528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176071.549759:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176071.549763:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176071.549765:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176071.549772:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549775:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176071.549778:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176071.549784:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176071.549792:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176071.549797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f3b80 x1872931145462528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176071.549806:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145463168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176071.549811:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145462528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176071.549883:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176071.549889:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176071.549892:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176071.549896:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176071.549906:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176071.549931:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9805
00000100:00080000:0.0:1786176071.549935:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176071.549938:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176071.549942:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176071.549963:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145463296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176071.549976:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145462528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176071.549985:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145462656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176071.550013:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176071.550023:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f0700 x1872931145462656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176071.550032:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145462656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176071.550037:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176071.550040:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176071.550042:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145462656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176071.550046:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145462784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176071.550057:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176071.550063:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f2680 x1872931145462784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176071.550071:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145462784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176071.550076:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176071.550077:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176071.550079:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145462784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176071.550103:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145462912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176071.550116:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176071.550123:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f1500 x1872931145462912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176071.550131:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145462912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176071.550136:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176071.550138:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176071.550140:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145462912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176071.550144:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145463040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176071.550154:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176071.550161:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f2d80 x1872931145463040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176071.550168:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145463040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176071.550173:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176071.550175:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176071.550177:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145463040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176071.550181:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145463168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176071.550191:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176071.550196:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f2a00 x1872931145463168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176071.550203:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145463168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176071.550208:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176071.550210:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176071.550212:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145463168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176071.550216:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145463296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176071.550226:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176071.550232:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176071/real 1786176071]  req@ffff89d9870f3480 x1872931145463296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176071.550239:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145463296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176071.550244:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176071.550245:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176071.550248:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145463296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176072.061047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176072.061161:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176072.572999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176073.085020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176073.085125:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176073.597001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176074.109034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176074.109186:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176074.621020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176075.133089:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176075.133159:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176075.645025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176076.156991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176076.157377:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176076.669054:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176076.669059:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176076.669070:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176076.669076:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176076.669091:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9810
00000100:00080000:0.0:1786176076.669108:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176076.669121:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176076.669176:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145463424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176076.669213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176076.669219:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176076.669223:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176076.669229:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9810
00000100:00080000:0.0:1786176076.669237:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176076.669242:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176076.669256:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176076.669267:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145463424:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176076.669279:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145463552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176076.669298:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176076.669302:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176076.669304:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176076.669310:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9810
00000100:00080000:0.0:1786176076.669314:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176076.669320:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176076.669327:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176076.669341:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145463680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176076.669353:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176076.669358:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176076.669361:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176076.669370:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9810
00000800:00000100:1.0:1786176076.669373:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176076.669408:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176076.669415:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176076.669422:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176076.669439:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145463808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176076.669452:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f1880 x1872931145463424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176076.669547:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176076.669552:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176076.669557:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145463424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176076.669558:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176076.669578:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9810
00000100:00080000:0.0:1786176076.669589:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176076.669596:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176076.669598:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176076.669607:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786176076.669609:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176076.669618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145463424:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176076.669634:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145463936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176076.669647:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176076.669651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176076.669653:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176076.669659:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9810
00000100:00080000:0.0:1786176076.669663:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176076.669665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145463552:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176076.669675:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176076.669685:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176076.669702:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145464064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176076.669715:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176076.669733:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176076.669743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f0e00 x1872931145463552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176076.669745:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176076.669756:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176076.669778:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9810
00000100:00100000:1.0:1786176076.669788:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145463552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176076.669790:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176076.669809:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176076.669830:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176076.669832:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176076.669849:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176076.669860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145463552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176076.669861:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145464192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176076.669889:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145463680:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176076.669940:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176076.669955:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176076.669956:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176076.669966:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176076.669976:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9810
00000100:00080000:0.0:1786176076.669982:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176076.669997:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176076.669998:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f3100 x1872931145463680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176076.670004:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176076.670033:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145464320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176076.670034:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145463680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176076.670111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176076.670112:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176076.670127:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176076.670129:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176076.670135:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176076.670143:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145463680:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176076.670152:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9810
00000100:00080000:0.0:1786176076.670158:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176076.670162:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145463808:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176076.670171:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176076.670180:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176076.670199:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145464448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176076.670210:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176076.670230:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f3480 x1872931145463808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176076.670289:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145463808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176076.670297:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176076.670300:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176076.670303:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145463808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176076.670310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145463936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176076.670325:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176076.670332:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f2a00 x1872931145463936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176076.670340:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145463936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176076.670346:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176076.670347:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176076.670349:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145463936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176076.670369:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145464064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176076.670400:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176076.670410:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f2d80 x1872931145464064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176076.670419:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145464064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176076.670425:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176076.670427:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176076.670429:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145464064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176076.670434:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145464192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176076.670448:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176076.670454:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f1500 x1872931145464192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176076.670462:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145464192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176076.670468:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176076.670471:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176076.670473:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145464192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176076.670477:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145464320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176076.670487:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176076.670493:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f2680 x1872931145464320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176076.670500:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145464320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176076.670507:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176076.670509:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176076.670511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145464320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176076.670515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145464448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176076.670525:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176076.670531:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176076/real 1786176076]  req@ffff89d9870f0700 x1872931145464448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176076.670539:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145464448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176076.670544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176076.670546:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176076.670548:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145464448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176077.181066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176077.181195:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176077.693028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176078.205008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176078.205229:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176078.716977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176079.229023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176079.229155:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176079.741105:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176080.253052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176080.253189:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176080.765003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176081.276985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176081.277113:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176081.789038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176081.789052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176081.789075:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176081.789093:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00080000:2.0:1786176081.789110:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176081.789122:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176081.789181:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145464576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176081.789217:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789224:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176081.789226:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176081.789231:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00080000:2.0:1786176081.789239:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176081.789246:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176081.789259:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176081.789260:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145464576:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176081.789281:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145464704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176081.789296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789301:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176081.789305:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176081.789313:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00080000:2.0:1786176081.789322:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176081.789342:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176081.789349:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176081.789367:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145464832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176081.789388:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789392:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176081.789394:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176081.789399:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00080000:2.0:1786176081.789403:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176081.789408:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176081.789414:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176081.789431:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176081.789434:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145464960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176081.789445:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789452:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176081.789455:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176081.789459:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00080000:2.0:1786176081.789463:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176081.789468:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176081.789473:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176081.789484:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145465088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176081.789493:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789497:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176081.789498:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176081.789503:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00080000:2.0:1786176081.789506:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176081.789508:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87d880 x1872931145464576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176081.789510:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176081.789515:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176081.789525:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145465216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176081.789529:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145464576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176081.789534:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789538:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176081.789540:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176081.789543:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176081.789546:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00080000:0.0:1786176081.789547:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176081.789550:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176081.789552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145464576:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176081.789555:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176081.789560:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176081.789572:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145465344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176081.789580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789583:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1786176081.789585:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145464704:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176081.789585:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176081.789591:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00080000:2.0:1786176081.789594:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176081.789598:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176081.789603:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176081.789610:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176081.789613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145465472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176081.789623:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87c700 x1872931145464704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176081.789623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176081.789627:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176081.789629:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176081.789634:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9816
00000100:00100000:0.0:1786176081.789637:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145464704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176081.789638:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176081.789643:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176081.789646:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176081.789649:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786176081.789649:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176081.789653:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145464704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176081.789659:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145464832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176081.789659:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145465600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176081.789683:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176081.789699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87c000 x1872931145464832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176081.789713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145464832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176081.789722:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176081.789726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176081.789729:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145464832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176081.789735:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145464960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176081.789772:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176081.789790:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87f800 x1872931145464960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176081.789806:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145464960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176081.789818:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176081.789821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176081.789824:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145464960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176081.789834:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145465088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176081.789861:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176081.789873:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87d500 x1872931145465088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176081.789892:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145465088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176081.789938:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176081.789944:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176081.789948:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145465088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176081.789955:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145465216:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176081.789981:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176081.789997:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87c380 x1872931145465216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176081.790013:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145465216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176081.790022:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176081.790025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176081.790033:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145465216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176081.790039:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145465344:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176081.790058:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176081.790071:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87df80 x1872931145465344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176081.790083:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145465344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176081.790097:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176081.790100:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176081.790102:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145465344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176081.790119:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145465472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176081.790135:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176081.790143:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87e680 x1872931145465472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176081.790151:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145465472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176081.790157:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176081.790160:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176081.790162:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145465472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176081.790165:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145465600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176081.790175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176081.790180:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176081/real 1786176081]  req@ffff89d99e87dc00 x1872931145465600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176081.790187:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145465600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176081.790193:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176081.790194:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176081.790197:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145465600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176082.300985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176082.301182:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176082.812996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176083.325055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176083.325203:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176083.837016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176084.348972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176084.349110:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176084.861011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176085.373012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176085.373126:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176085.885039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176086.397049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176086.397220:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176086.909064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176086.909067:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176086.909085:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176086.909092:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176086.909107:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00080000:0.0:1786176086.909119:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176086.909129:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176086.909174:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145465728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176086.909234:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176086.909242:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176086.909245:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176086.909253:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00080000:0.0:1786176086.909260:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176086.909266:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176086.909300:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176086.909325:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145465856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176086.909336:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145465728:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176086.909350:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176086.909356:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176086.909359:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176086.909365:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00080000:0.0:1786176086.909372:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176086.909378:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176086.909386:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176086.909402:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145465984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176086.909417:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176086.909420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176086.909423:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176086.909426:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176086.909432:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00080000:0.0:1786176086.909437:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176086.909443:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176086.909451:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176086.909469:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145466112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176086.909485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176086.909491:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176086.909494:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176086.909501:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00100000:1.0:1786176086.909501:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f3b80 x1872931145465728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176086.909507:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176086.909513:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176086.909522:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176086.909532:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145465728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176086.909538:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145466240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176086.909551:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176086.909558:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176086.909565:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145465728:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176086.909566:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176086.909572:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176086.909575:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176086.909581:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00080000:0.0:1786176086.909586:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176086.909591:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176086.909598:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145465856:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176086.909599:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176086.909615:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145466368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176086.909632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176086.909637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176086.909638:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176086.909642:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176086.909648:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00080000:0.0:1786176086.909653:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176086.909674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f0a80 x1872931145465856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176086.909676:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176086.909685:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176086.909701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145465856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176086.909703:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145466496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176086.909721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176086.909728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176086.909732:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176086.909738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176086.909740:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00080000:1.0:1786176086.909745:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176086.909746:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176086.909752:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145465856:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176086.909753:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176086.909762:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176086.909764:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145465984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176086.909780:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145466624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176086.909798:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176086.909800:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176086.909804:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176086.909808:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176086.909815:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9821
00000100:00080000:0.0:1786176086.909821:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176086.909821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f1180 x1872931145465984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176086.909827:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176086.909836:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176086.909845:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145465984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176086.909854:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145466752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176086.909862:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176086.909869:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176086.909875:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145465984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176086.909886:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145466112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176086.909963:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176086.909982:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f0700 x1872931145466112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176086.909998:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145466112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176086.910008:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176086.910012:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176086.910017:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145466112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176086.910025:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145466240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176086.910047:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176086.910058:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f2680 x1872931145466240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176086.910072:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145466240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176086.910081:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176086.910085:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176086.910088:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145466240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176086.910113:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145466368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176086.910132:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176086.910145:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f1500 x1872931145466368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176086.910159:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145466368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176086.910169:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176086.910172:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176086.910176:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145466368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176086.910183:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145466496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176086.910201:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176086.910213:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f2d80 x1872931145466496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176086.910247:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145466496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176086.910256:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176086.910259:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176086.910262:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145466496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176086.910268:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145466624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176086.910312:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176086.910325:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f2a00 x1872931145466624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176086.910339:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145466624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176086.910349:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176086.910352:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176086.910356:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145466624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176086.910362:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145466752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176086.910380:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176086.910390:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176086/real 1786176086]  req@ffff89d9870f3480 x1872931145466752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176086.910402:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145466752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176086.910412:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176086.910416:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176086.910419:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145466752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176087.421012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176087.421162:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176087.932991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176088.445032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176088.445133:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176088.957010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176089.469007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176089.469115:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176089.981009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176090.493118:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176090.493192:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176091.004967:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176091.517027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176091.517072:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176092.028958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176092.029024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176092.029032:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176092.029038:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176092.029047:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:2.0:1786176092.029057:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029063:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176092.029094:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145466880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176092.029116:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176092.029119:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176092.029120:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176092.029123:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:2.0:1786176092.029125:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029128:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176092.029135:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176092.029146:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145467008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176092.029154:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176092.029156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176092.029158:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176092.029164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145466880:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176092.029164:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:2.0:1786176092.029167:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029172:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176092.029178:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176092.029187:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145467136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176092.029192:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176092.029194:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176092.029196:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176092.029198:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:2.0:1786176092.029201:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029204:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176092.029207:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176092.029214:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145467264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176092.029219:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176092.029221:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176092.029223:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176092.029226:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:2.0:1786176092.029228:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029247:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176092.029252:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176092.029252:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176092.029265:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145467392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176092.029272:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176092.029275:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176092.029276:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176092.029279:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:2.0:1786176092.029282:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029285:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176092.029289:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176092.029297:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145467520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176092.029304:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87ca80 x1872931145466880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176092.029307:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176092.029314:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176092.029316:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176092.029325:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:2.0:1786176092.029329:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029332:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176092.029335:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176092.029340:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145466880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176092.029343:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145467648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176092.029372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176092.029375:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176092.029375:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176092.029379:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176092.029386:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:1.0:1786176092.029387:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176092.029388:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029394:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176092.029399:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145466880:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176092.029399:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176092.029410:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145467776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176092.029416:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176092.029418:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176092.029419:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176092.029421:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9826
00000100:00080000:2.0:1786176092.029423:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176092.029425:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176092.029429:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176092.029431:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145467008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176092.029437:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145467904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176092.029466:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176092.029491:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87ed80 x1872931145467008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176092.029507:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145467008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176092.029517:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176092.029520:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176092.029524:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145467008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176092.029531:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145467136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176092.029553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176092.029575:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87f100 x1872931145467136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176092.029589:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145467136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176092.029599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176092.029602:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176092.029606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145467136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176092.029613:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145467264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176092.029634:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176092.029647:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87dc00 x1872931145467264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176092.029660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145467264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176092.029669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176092.029672:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176092.029676:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145467264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176092.029683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145467392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176092.029705:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176092.029718:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87e680 x1872931145467392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176092.029732:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145467392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176092.029741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176092.029745:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176092.029748:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145467392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176092.029755:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145467520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176092.029775:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176092.029788:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87df80 x1872931145467520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176092.029802:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145467520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176092.029812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176092.029815:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176092.029819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145467520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176092.029826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145467648:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176092.029845:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176092.029857:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87c380 x1872931145467648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176092.029869:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145467648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176092.029877:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176092.029880:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176092.029884:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145467648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176092.029890:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145467776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176092.029935:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176092.029948:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87d500 x1872931145467776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176092.029961:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145467776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176092.029970:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176092.029974:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176092.029978:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145467776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176092.030003:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145467904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176092.030027:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176092.030039:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176092/real 1786176092]  req@ffff89d99e87f800 x1872931145467904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176092.030053:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145467904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176092.030063:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176092.030067:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176092.030070:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145467904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176092.540988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176092.541060:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176093.053016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176093.565027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176093.565199:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176094.076988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176094.589015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176094.589080:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176095.100960:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176095.612973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176095.613037:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176096.125016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176096.637066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176096.637113:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176097.148979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176097.149033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176097.149042:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176097.149046:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149057:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00080000:0.0:1786176097.149069:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176097.149076:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176097.149122:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145468032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176097.149150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176097.149153:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176097.149154:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149157:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00080000:0.0:1786176097.149160:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176097.149163:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176097.149173:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176097.149196:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145468160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176097.149207:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176097.149215:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176097.149216:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145468032:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176097.149217:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149231:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00080000:0.0:1786176097.149235:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176097.149238:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176097.149243:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176097.149254:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145468288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176097.149261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176097.149264:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176097.149265:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149270:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00080000:0.0:1786176097.149282:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176097.149287:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176097.149292:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176097.149293:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176097.149309:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145468416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176097.149317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176097.149320:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176097.149322:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149327:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00080000:0.0:1786176097.149332:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176097.149335:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176097.149339:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176097.149343:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f3100 x1872931145468032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176097.149353:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145468544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176097.149372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176097.149375:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145468032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176097.149377:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176097.149381:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149394:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00080000:0.0:1786176097.149400:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176097.149401:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176097.149407:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176097.149414:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.149432:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145468032:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176097.149435:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176097.149447:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145468672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176097.149458:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145468160:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176097.149483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176097.149486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176097.149488:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149494:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00080000:0.0:1786176097.149499:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176097.149504:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176097.149508:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176097.149514:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176097.149522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f0e00 x1872931145468160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176097.149527:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145468800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176097.149537:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176097.149545:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176097.149550:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149579:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00100000:1.0:1786176097.149580:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145468160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176097.149585:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176097.149597:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176097.149606:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176097.149627:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176097.149633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145468928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176097.149635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.149648:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145468160:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176097.149667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176097.149673:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176097.149674:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145468288:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176097.149676:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176097.149688:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9831
00000100:00080000:0.0:1786176097.149691:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176097.149694:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176097.149704:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176097.149706:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176097.149716:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f1880 x1872931145468288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176097.149722:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145469056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176097.149743:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145468288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176097.149751:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176097.149754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.149756:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145468288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176097.149762:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145468416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176097.149776:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176097.149782:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f3480 x1872931145468416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176097.149789:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145468416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176097.149794:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176097.149796:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.149798:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145468416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176097.149802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145468544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176097.149812:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176097.149818:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f2a00 x1872931145468544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176097.149825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145468544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176097.149830:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176097.149832:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.149833:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145468544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176097.149847:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145468672:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176097.149857:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176097.149863:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f2d80 x1872931145468672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176097.149871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145468672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176097.149875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176097.149877:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.149879:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145468672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176097.149883:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145468800:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176097.149892:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176097.149918:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f1500 x1872931145468800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176097.149926:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145468800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176097.149932:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176097.149934:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.149936:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145468800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176097.149940:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145468928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176097.149952:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176097.149958:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f2680 x1872931145468928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176097.149966:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145468928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176097.149971:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176097.149973:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.149975:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145468928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176097.149978:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145469056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176097.149988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176097.149993:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176097/real 1786176097]  req@ffff89d9870f0700 x1872931145469056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176097.150002:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145469056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176097.150011:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176097.150015:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176097.150018:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145469056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176097.661000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176097.661196:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176098.172978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176098.685036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176098.685130:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176099.197071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176099.708990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176099.709038:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176100.221052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176100.732996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176100.733053:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176101.245024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176101.756998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176101.757061:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176102.268999:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176102.269000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176102.269009:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176102.269014:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176102.269025:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9836
00000100:00080000:0.0:1786176102.269036:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176102.269046:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176102.269087:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145469184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176102.269118:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176102.269122:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176102.269124:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176102.269128:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9836
00000100:00080000:0.0:1786176102.269148:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176102.269153:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176102.269160:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145469184:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176102.269165:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176102.269184:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145469312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176102.269203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176102.269207:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176102.269210:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176102.269215:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9836
00000800:00000100:1.0:1786176102.269220:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176102.269223:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176102.269231:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176102.269238:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176102.269252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145469440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176102.269259:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f1180 x1872931145469184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176102.269262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176102.269270:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176102.269274:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176102.269284:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9836
00000100:00100000:1.0:1786176102.269289:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145469184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176102.269290:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176102.269300:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176102.269303:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176102.269309:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176102.269309:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176102.269316:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145469184:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176102.269330:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145469568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176102.269338:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145469312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176102.269351:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176102.269356:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176102.269359:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176102.269364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176102.269368:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9836
00000100:00080000:0.0:1786176102.269374:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176102.269378:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f0a80 x1872931145469312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176102.269381:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176102.269389:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176102.269396:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145469312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176102.269404:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145469696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176102.269406:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176102.269415:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176102.269420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176102.269423:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145469312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176102.269424:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176102.269428:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176102.269432:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145469440:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176102.269434:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9836
00000100:00080000:0.0:1786176102.269441:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176102.269444:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176102.269448:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176102.269457:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176102.269461:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145469824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176102.269471:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176102.269471:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f3b80 x1872931145469440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176102.269479:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176102.269499:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176102.269510:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9836
00000100:00100000:1.0:1786176102.269514:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145469440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176102.269518:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176102.269527:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176102.269534:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176102.269536:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176102.269543:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176102.269550:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145469440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176102.269565:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145469952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176102.269566:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145469568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176102.269590:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176102.269597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176102.269602:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786176102.269604:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f0700 x1872931145469568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176102.269606:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176102.269617:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9836
00000100:00080000:0.0:1786176102.269622:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176102.269622:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145469568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176102.269630:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176102.269639:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176102.269641:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176102.269646:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176102.269650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145469568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176102.269657:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145470080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176102.269659:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145469696:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176102.269676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176102.269699:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176102.269702:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176102.269707:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176102.269712:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9836
00000100:00080000:0.0:1786176102.269718:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176102.269720:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f2680 x1872931145469696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176102.269727:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176102.269736:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176102.269736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145469696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176102.269763:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176102.269767:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176102.269773:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145469696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176102.269774:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145470208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176102.269779:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145469824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176102.269801:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176102.269813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f1500 x1872931145469824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176102.269823:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145469824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176102.269829:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176102.269830:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176102.269832:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145469824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176102.269843:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145469952:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176102.269856:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176102.269867:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f2d80 x1872931145469952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176102.269889:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145469952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176102.269897:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176102.269900:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176102.269904:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145469952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176102.269910:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145470080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176102.269967:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176102.269982:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f2a00 x1872931145470080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176102.269995:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145470080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176102.270003:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176102.270007:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176102.270010:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145470080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176102.270017:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145470208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176102.270037:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176102.270049:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176102/real 1786176102]  req@ffff89d9870f3480 x1872931145470208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176102.270061:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145470208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176102.270075:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176102.270079:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176102.270082:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145470208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176102.781050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176102.781109:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176103.292956:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176103.805019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176103.805058:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176104.317020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176104.829001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176104.829077:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176105.341048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176105.853004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176105.853177:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176106.364954:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176106.877017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176106.877147:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176107.389173:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176107.389185:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176107.389186:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176107.389194:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176107.389209:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389230:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176107.389257:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176107.389312:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145470336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176107.389342:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176107.389346:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176107.389347:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176107.389351:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389355:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176107.389358:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176107.389370:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176107.389382:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145470464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176107.389393:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176107.389395:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145470336:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176107.389398:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176107.389418:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176107.389430:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389434:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176107.389438:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176107.389443:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176107.389459:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145470592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176107.389487:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176107.389492:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176107.389495:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176107.389498:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389506:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176107.389512:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176107.389521:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176107.389555:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145470720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176107.389585:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176107.389595:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176107.389600:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176107.389603:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176107.389609:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389614:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176107.389618:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176107.389624:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176107.389636:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145470848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176107.389644:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176107.389647:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176107.389648:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176107.389653:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87c000 x1872931145470336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176107.389656:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389662:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176107.389669:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176107.389675:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176107.389685:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145470336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176107.389687:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145470976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176107.389718:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176107.389720:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176107.389722:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176107.389726:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176107.389729:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176107.389733:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389737:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176107.389739:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145470336:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176107.389744:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176107.389749:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176107.389760:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145471104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176107.389769:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176107.389772:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176107.389773:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176107.389780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145470464:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176107.389780:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389782:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176107.389790:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176107.389794:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176107.389805:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145471232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176107.389814:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176107.389819:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176107.389820:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176107.389825:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176107.389830:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9841
00000100:00080000:2.0:1786176107.389833:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176107.389837:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176107.389840:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87c700 x1872931145470464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176107.389843:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176107.389867:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145471360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176107.389872:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145470464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176107.389893:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176107.389920:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176107.389925:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145470464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176107.389951:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145470592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176107.389976:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176107.389996:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87d880 x1872931145470592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176107.390029:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145470592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176107.390039:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176107.390042:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176107.390047:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145470592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176107.390054:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145470720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176107.390076:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176107.390119:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87f800 x1872931145470720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176107.390159:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145470720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176107.390165:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176107.390168:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176107.390171:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145470720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176107.390176:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145470848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176107.390192:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176107.390201:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87d500 x1872931145470848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176107.390210:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145470848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176107.390216:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176107.390218:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176107.390220:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145470848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176107.390224:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145470976:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176107.390236:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176107.390243:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87c380 x1872931145470976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176107.390253:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145470976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176107.390259:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176107.390261:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176107.390263:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145470976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176107.390279:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145471104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176107.390292:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176107.390299:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87df80 x1872931145471104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176107.390309:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145471104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176107.390315:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176107.390318:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176107.390320:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145471104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176107.390324:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145471232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176107.390336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176107.390359:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87e680 x1872931145471232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176107.390371:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145471232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176107.390380:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176107.390383:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176107.390386:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145471232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176107.390391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145471360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176107.390411:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176107.390427:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176107/real 1786176107]  req@ffff89d99e87dc00 x1872931145471360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176107.390465:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145471360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176107.390481:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176107.390487:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176107.390495:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145471360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176107.900975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176107.901125:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176108.413033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176108.925009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176108.925193:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176109.437056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176109.949101:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176109.949101:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786176110.460970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176110.972996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176110.973083:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176111.485010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176111.996984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176111.997049:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176112.508976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176112.509011:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176112.509019:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176112.509023:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176112.509063:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9846
00000100:00080000:0.0:1786176112.509073:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176112.509081:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176112.509120:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145471488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176112.509147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176112.509152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176112.509154:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176112.509159:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9846
00000100:00080000:0.0:1786176112.509163:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176112.509168:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176112.509177:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145471488:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176112.509178:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176112.509209:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145471616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176112.509222:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176112.509226:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176112.509229:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176112.509233:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9846
00000100:00080000:0.0:1786176112.509238:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176112.509242:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176112.509247:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176112.509249:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176112.509266:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145471744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176112.509278:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176112.509282:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786176112.509285:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f1880 x1872931145471488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176112.509286:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176112.509296:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9846
00000100:00080000:0.0:1786176112.509303:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176112.509308:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145471488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176112.509309:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176112.509320:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176112.509322:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176112.509327:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176112.509331:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145471488:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176112.509337:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145471872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176112.509358:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176112.509361:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145471616:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176112.509365:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176112.509369:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176112.509376:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9846
00000100:00080000:0.0:1786176112.509381:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176112.509383:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176112.509389:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176112.509395:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f0e00 x1872931145471616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176112.509396:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176112.509409:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145471616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176112.509416:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145472000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176112.509418:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176112.509426:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176112.509433:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145471616:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176112.509442:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176112.509443:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145471744:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176112.509451:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176112.509455:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176112.509461:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9846
00000800:00000100:1.0:1786176112.509466:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176112.509468:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176112.509475:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176112.509477:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f3100 x1872931145471744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176112.509483:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176112.509488:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145471744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176112.509497:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176112.509502:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145472128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176112.509502:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176112.509509:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145471744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176112.509519:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145471872:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176112.509527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176112.509532:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176112.509535:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176112.509537:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176112.509544:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9846
00000100:00100000:1.0:1786176112.509549:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f3480 x1872931145471872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176112.509551:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176112.509560:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176112.509564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145471872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176112.509568:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176112.509573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176112.509577:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176112.509579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145471872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176112.509587:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145472256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176112.509594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145472000:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176112.509608:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176112.509613:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786176112.509614:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176112.509618:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176112.509626:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9846
00000100:00100000:1.0:1786176112.509627:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f2a00 x1872931145472000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176112.509633:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176112.509642:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176112.509649:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145472000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176112.509651:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176112.509662:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176112.509664:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176112.509667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145472000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176112.509672:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145472384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176112.509676:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145472128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176112.509690:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176112.509696:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176112.509698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176112.509702:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176112.509706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f2d80 x1872931145472128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176112.509711:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9846
00000100:00080000:0.0:1786176112.509719:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176112.509725:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145472128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176112.509727:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176112.509736:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176112.509740:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176112.509746:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176112.509751:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145472512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176112.509753:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145472128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176112.509787:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145472256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176112.509805:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176112.509813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f1500 x1872931145472256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176112.509820:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145472256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176112.509830:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176112.509832:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176112.509834:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145472256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176112.509838:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145472384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176112.509848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176112.509853:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f2680 x1872931145472384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176112.509860:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145472384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176112.509866:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176112.509867:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176112.509869:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145472384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176112.509872:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145472512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176112.509882:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176112.509887:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176112/real 1786176112]  req@ffff89d9870f0700 x1872931145472512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176112.509894:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145472512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176112.509917:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176112.509919:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176112.509922:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145472512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176113.020979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176113.021098:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176113.533000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176114.045104:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176114.045146:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176114.556977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176115.069099:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176115.069236:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176115.581051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176116.092982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176116.093055:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176116.604977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176117.116975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176117.117078:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176117.629003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176117.629046:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176117.629054:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176117.629059:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176117.629078:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629087:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629096:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176117.629132:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145472640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176117.629168:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176117.629173:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176117.629175:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176117.629180:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629185:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629189:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176117.629200:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176117.629205:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145472640:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176117.629219:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145472768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176117.629231:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176117.629234:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176117.629237:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176117.629241:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629245:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629248:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176117.629252:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176117.629262:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145472896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176117.629268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176117.629271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176117.629272:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176117.629275:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629277:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629279:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176117.629283:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176117.629292:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145473024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176117.629299:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176117.629302:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176117.629303:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176117.629306:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629309:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629312:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176117.629316:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176117.629322:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145473152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176117.629329:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786176117.629331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176117.629332:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176117.629336:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176117.629340:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629343:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629346:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176117.629349:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176117.629358:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145473280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176117.629364:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176117.629366:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176117.629368:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176117.629372:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f3b80 x1872931145472640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176117.629374:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629380:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629387:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176117.629392:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176117.629399:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145472640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176117.629403:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145473408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176117.629425:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176117.629427:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176117.629428:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176117.629432:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176117.629437:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176117.629438:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629443:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629449:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176117.629450:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145472640:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176117.629452:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176117.629463:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145473536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176117.629470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176117.629472:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176117.629473:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176117.629475:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9851
00000100:00080000:0.0:1786176117.629477:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176117.629479:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176117.629481:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176117.629487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145473664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176117.629587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145472768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176117.629651:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176117.629664:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f0a80 x1872931145472768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176117.629678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145472768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176117.629684:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176117.629686:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176117.629689:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145472768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176117.629693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145472896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176117.629706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176117.629713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f1180 x1872931145472896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176117.629720:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145472896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176117.629729:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176117.629732:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176117.629735:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145472896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176117.629741:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145473024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176117.629761:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176117.629773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f0700 x1872931145473024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176117.629786:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145473024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176117.629797:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176117.629799:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176117.629801:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145473024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176117.629805:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145473152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176117.629820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176117.629827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f2680 x1872931145473152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176117.629834:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145473152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176117.629839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176117.629841:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176117.629843:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145473152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176117.629847:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145473280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176117.629856:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176117.629862:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f1500 x1872931145473280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176117.629869:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145473280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176117.629874:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176117.629875:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176117.629878:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145473280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176117.629881:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145473408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176117.629890:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176117.629923:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f2d80 x1872931145473408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176117.629932:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145473408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176117.629938:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176117.629941:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176117.629945:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145473408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176117.629950:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145473536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176117.629962:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176117.629969:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f2a00 x1872931145473536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176117.629976:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145473536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176117.629981:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176117.629998:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176117.630001:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145473536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176117.630005:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145473664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176117.630020:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176117.630027:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176117/real 1786176117]  req@ffff89d9870f3480 x1872931145473664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176117.630035:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145473664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176117.630041:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176117.630042:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176117.630044:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145473664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176118.141007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176118.141085:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176118.653018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176119.165040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176119.165160:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176119.677020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176120.189049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176120.189181:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176120.701005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176121.212983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176121.213099:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176121.725064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176122.237032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176122.237095:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176122.749012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176122.749036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176122.749042:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176122.749046:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749054:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749062:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176122.749068:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176122.749104:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145473792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176122.749123:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176122.749126:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176122.749127:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749130:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749133:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176122.749136:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176122.749144:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176122.749153:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145473792:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176122.749155:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145473920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176122.749165:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176122.749168:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176122.749169:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749173:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749175:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176122.749178:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176122.749181:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176122.749189:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145474048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176122.749196:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176122.749198:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176122.749200:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749202:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749205:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176122.749207:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176122.749210:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176122.749217:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145474176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176122.749230:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176122.749233:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176122.749235:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749239:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749242:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176122.749245:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176122.749249:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176122.749252:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145473920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176122.749261:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145474304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176122.749269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176122.749272:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176122.749273:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749277:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749279:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176122.749282:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176122.749285:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176122.749295:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145474048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176122.749297:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145474432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176122.749307:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176122.749310:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176122.749311:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749314:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749317:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176122.749319:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176122.749323:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176122.749333:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145474176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176122.749334:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145474560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176122.749344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176122.749347:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176122.749348:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749353:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749356:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176122.749359:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176122.749363:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176122.749363:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145474304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176122.749379:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145474688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176122.749387:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176122.749389:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145474432:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176122.749391:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176122.749395:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176122.749403:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9856
00000100:00080000:0.0:1786176122.749418:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176122.749419:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145474560:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176122.749427:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176122.749434:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176122.749439:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145474688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176122.749450:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145474816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176122.749490:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145474816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176123.260992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176123.261074:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176123.773016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176124.285021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176124.285165:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176124.797101:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176125.309034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176125.309143:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176125.820973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786176125.821143:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786176125.821205:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786176125.821238:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176125.821290:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786176125.821325:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176125.821337:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f0700 x1872931145474816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176125.821338:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176125.821353:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176125.821368:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176125.821372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145474816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176125.821382:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176125.821391:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176125.821397:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786176125.821403:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821411:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821417:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145474816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176125.821425:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f2680 x1872931145474688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176125.821440:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145474688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176125.821448:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821452:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821456:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145474688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176125.821462:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f2a00 x1872931145474304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176125.821472:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145474304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176125.821479:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821483:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145474304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176125.821492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f2d80 x1872931145474432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176125.821503:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145474432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176125.821511:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821514:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145474432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176125.821524:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f1500 x1872931145474560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176125.821536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145474560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176125.821544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821547:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821551:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145474560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176125.821558:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f0e00 x1872931145473920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176125.821569:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145473920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176125.821577:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821580:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821584:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145473920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176125.821591:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f1880 x1872931145474048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176125.821603:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145474048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176125.821612:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821619:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145474048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176125.821626:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f3480 x1872931145474176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176125.821639:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145474176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176125.821646:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821649:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821653:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145474176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176125.821660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176122/real 1786176125]  req@ffff89d9870f3100 x1872931145473792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176125.821673:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145473792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176125.821698:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176125.821710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176125.821714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145473792:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176126.333006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176126.333077:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176126.845024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176127.357020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176127.357118:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176127.868993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176127.869088:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176127.869094:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176127.869100:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869111:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00080000:2.0:1786176127.869137:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869146:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176127.869191:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145474944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176127.869218:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176127.869221:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176127.869223:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869226:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00080000:2.0:1786176127.869229:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869232:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176127.869243:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176127.869269:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145474944:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176127.869273:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145475072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176127.869292:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176127.869295:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176127.869297:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869301:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00080000:2.0:1786176127.869305:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869307:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176127.869312:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176127.869339:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145475200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176127.869346:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176127.869350:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176127.869352:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869356:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00080000:2.0:1786176127.869364:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869369:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176127.869375:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176127.869392:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176127.869393:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145475328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176127.869407:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176127.869411:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176127.869413:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869425:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00080000:2.0:1786176127.869431:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869436:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176127.869442:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176127.869457:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145475456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176127.869467:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87f100 x1872931145474944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176127.869472:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176127.869488:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176127.869490:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869496:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00100000:3.0:1786176127.869501:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145474944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176127.869503:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869514:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176127.869525:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176127.869526:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176127.869535:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176127.869543:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145475584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176127.869544:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145474944:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176127.869562:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176127.869566:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176127.869568:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869574:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00080000:2.0:1786176127.869578:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869582:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176127.869587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145475072:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176127.869591:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176127.869610:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145475712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176127.869629:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176127.869633:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176127.869639:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176127.869641:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869649:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00100000:3.0:1786176127.869651:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87ed80 x1872931145475072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176127.869655:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869665:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176127.869673:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176127.869678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145475072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176127.869690:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786176127.869692:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145475840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176127.869699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176127.869709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145475072:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176127.869715:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176127.869721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145475200:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176127.869723:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176127.869727:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176127.869736:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9862
00000100:00080000:2.0:1786176127.869741:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176127.869746:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176127.869753:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176127.869754:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176127.869773:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145475968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176127.869774:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87ca80 x1872931145475200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176127.869812:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145475200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176127.869822:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176127.869827:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176127.869832:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145475200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176127.869840:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145475328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176127.869866:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176127.869881:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87dc00 x1872931145475328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176127.870064:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145475328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176127.870074:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176127.870077:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176127.870081:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145475328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176127.870089:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145475456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176127.870116:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176127.870129:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87e680 x1872931145475456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176127.870142:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145475456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176127.870151:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176127.870155:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176127.870158:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145475456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176127.870165:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145475584:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176127.870184:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176127.870195:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87df80 x1872931145475584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176127.870206:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145475584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176127.870220:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176127.870224:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176127.870228:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145475584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176127.870249:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145475712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176127.870271:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176127.870282:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87c380 x1872931145475712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176127.870296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145475712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176127.870304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176127.870308:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176127.870311:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145475712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176127.870318:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145475840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176127.870340:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176127.870353:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87d500 x1872931145475840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176127.870367:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145475840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176127.870378:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176127.870381:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176127.870386:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145475840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176127.870393:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145475968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176127.870416:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176127.870429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176127/real 1786176127]  req@ffff89d99e87f800 x1872931145475968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176127.870442:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145475968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176127.870451:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176127.870455:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176127.870458:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145475968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176128.380987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176128.381070:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176128.893053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176129.405015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176129.405090:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176129.917014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176130.429036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176130.429126:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176130.941004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176131.453007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176131.453061:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176131.964978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176132.477023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176132.477124:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176132.988998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176132.989042:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176132.989050:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176132.989056:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989068:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9867
00000100:00080000:0.0:1786176132.989082:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989093:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176132.989150:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145476096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176132.989182:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176132.989186:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176132.989188:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989192:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9867
00000100:00080000:0.0:1786176132.989196:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989200:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176132.989210:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176132.989225:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145476224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176132.989238:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176132.989241:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176132.989244:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989248:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9867
00000100:00080000:0.0:1786176132.989251:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989256:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176132.989265:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176132.989266:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145476096:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176132.989282:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145476352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176132.989302:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176132.989306:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176132.989308:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989312:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9867
00000100:00080000:0.0:1786176132.989315:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989319:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176132.989324:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176132.989337:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145476480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176132.989347:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176132.989351:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176132.989353:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989362:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9867
00000800:00000100:3.0:1786176132.989366:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176132.989369:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989377:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176132.989383:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176132.989396:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145476608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176132.989406:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176132.989410:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176132.989412:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989416:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9867
00000100:00080000:0.0:1786176132.989420:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989424:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176132.989430:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176132.989444:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145476736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176132.989448:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f1180 x1872931145476096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176132.989474:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176132.989488:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176132.989503:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989513:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9867
00000100:00100000:3.0:1786176132.989515:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145476096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176132.989517:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989529:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176132.989540:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176132.989546:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.989554:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176132.989559:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145476864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176132.989566:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145476096:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176132.989587:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176132.989591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145476224:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176132.989592:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176132.989596:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989605:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9867
00000100:00080000:0.0:1786176132.989609:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989613:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176132.989618:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176132.989631:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145476992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176132.989651:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786176132.989653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176132.989659:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176132.989663:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176132.989669:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9867
00000100:00080000:0.0:1786176132.989677:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176132.989680:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176132.989686:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176132.989690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f0a80 x1872931145476224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176132.989703:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145477120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176132.989716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145476224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176132.989728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.989733:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176132.989740:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145476224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176132.989782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145476352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176132.989808:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176132.989821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f3b80 x1872931145476352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176132.989867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145476352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176132.989885:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.989889:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176132.989893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145476352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176132.989927:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145476480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176132.989954:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176132.989968:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f3100 x1872931145476480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176132.989981:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145476480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176132.989990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.989993:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176132.989996:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145476480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176132.990002:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145476608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176132.990019:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176132.990028:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f3480 x1872931145476608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176132.990040:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145476608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176132.990048:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.990051:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176132.990055:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145476608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176132.990060:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145476736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176132.990089:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176132.990100:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f1880 x1872931145476736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176132.990111:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145476736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176132.990119:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.990122:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176132.990125:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145476736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176132.990130:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145476864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176132.990147:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176132.990161:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f0e00 x1872931145476864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176132.990181:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145476864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176132.990211:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.990218:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176132.990224:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145476864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176132.990236:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145476992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176132.990275:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176132.990298:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f1500 x1872931145476992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176132.990314:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145476992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176132.990325:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.990328:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176132.990333:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145476992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176132.990358:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145477120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176132.990380:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176132.990391:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176132/real 1786176132]  req@ffff89d9870f2d80 x1872931145477120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176132.990420:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145477120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176157 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176132.990431:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176132.990434:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176132.990438:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145477120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176133.501028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176133.501082:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176134.012986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176134.525015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176134.525093:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176135.036997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176135.549034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176135.549163:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176136.061052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176136.572971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176136.573034:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176137.084990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176137.597043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176137.597172:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176138.108995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176138.109118:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176138.109131:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176138.109137:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176138.109150:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9872
00000100:00080000:2.0:1786176138.109165:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176138.109174:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176138.109225:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145477248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176138.109268:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176138.109273:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176138.109276:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176138.109281:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9872
00000100:00080000:2.0:1786176138.109285:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176138.109290:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176138.109304:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176138.109323:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145477376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176138.109344:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145477248:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176138.109349:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176138.109366:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176138.109370:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176138.109376:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9872
00000100:00080000:2.0:1786176138.109381:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176138.109388:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176138.109394:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176138.109411:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145477504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176138.109424:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176138.109431:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176138.109433:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176138.109440:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9872
00000100:00080000:2.0:1786176138.109457:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176138.109462:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176138.109471:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176138.109481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176138.109504:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145477632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176138.109528:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176138.109554:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176138.109559:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176138.109567:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87d880 x1872931145477248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176138.109579:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9872
00000100:00080000:2.0:1786176138.109590:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176138.109600:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176138.109640:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176138.109642:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145477248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176138.109676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786176138.109678:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145477760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176138.109705:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176138.109710:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176138.109723:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145477248:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176138.109725:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176138.109739:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176138.109753:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9872
00000100:00080000:2.0:1786176138.109763:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176138.109771:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176138.109807:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176138.109817:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145477376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176138.109851:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145477888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176138.109872:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176138.109876:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176138.109886:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176138.109890:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176138.109940:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87c700 x1872931145477376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176138.109967:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145477376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176138.109981:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176138.109986:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176138.109992:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145477376:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176138.110006:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9872
00000100:00100000:3.0:1786176138.110009:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145477504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176138.110027:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176138.110044:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786176138.110057:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176138.110060:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176138.110076:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87c000 x1872931145477504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176138.110096:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145478016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176138.110099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145477504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176138.110202:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176138.110207:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176138.110221:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176138.110223:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176138.110236:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176138.110241:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145477504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176138.110251:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9872
00000100:00080000:2.0:1786176138.110263:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176138.110263:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145477632:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176138.110284:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176138.110301:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176138.110307:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176138.110326:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87f800 x1872931145477632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176138.110345:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145478144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176138.110350:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145477632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176138.110465:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176138.110472:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176138.110474:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176138.110490:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145477632:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176138.110497:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786176138.110505:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145477760:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176138.110509:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176138.110526:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9872
00000800:00000100:3.0:1786176138.110537:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176138.110538:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176138.110555:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176138.110557:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87d500 x1872931145477760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176138.110578:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176138.110617:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145477760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176138.110618:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145478272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176138.110731:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176138.110744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176138.110755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145477760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176138.110821:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145477888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176138.110858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176138.110875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87c380 x1872931145477888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176138.110892:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145477888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176138.110935:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176138.110940:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176138.110944:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145477888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176138.110953:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145478016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176138.110979:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176138.110993:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87df80 x1872931145478016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176138.111008:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145478016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176138.111027:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176138.111031:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176138.111035:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145478016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176138.111043:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145478144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176138.111062:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176138.111073:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87e680 x1872931145478144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176138.111088:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145478144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176138.111099:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176138.111103:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176138.111106:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145478144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176138.111114:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145478272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176138.111132:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176138.111143:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176138/real 1786176138]  req@ffff89d99e87dc00 x1872931145478272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176138.111158:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145478272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176138.111168:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176138.111171:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176138.111177:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145478272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176138.621031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176138.621216:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176139.132987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176139.645063:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176139.645235:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176140.157068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176140.669007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176140.669258:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176141.181035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176141.693017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176141.693117:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176142.205028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176142.717030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176142.717177:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176143.229058:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176143.229063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176143.229076:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176143.229084:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176143.229104:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:2.0:1786176143.229121:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176143.229134:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176143.229217:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145478400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176143.229255:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176143.229263:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176143.229267:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176143.229275:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:2.0:1786176143.229283:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176143.229291:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176143.229307:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176143.229330:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145478400:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176143.229331:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145478528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176143.229362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176143.229368:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176143.229371:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176143.229378:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:2.0:1786176143.229401:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176143.229409:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176143.229418:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176143.229423:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176143.229439:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145478656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176143.229457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176143.229463:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176143.229466:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176143.229472:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:2.0:1786176143.229478:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176143.229484:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176143.229487:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87ca80 x1872931145478400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176143.229494:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176143.229512:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145478784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176143.229517:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145478400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176143.229531:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176143.229537:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176143.229539:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176143.229540:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176143.229546:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176143.229547:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:2.0:1786176143.229554:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176143.229554:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145478400:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176143.229561:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176143.229568:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176143.229584:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145478912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176143.229589:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145478528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176143.229604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176143.229610:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176143.229613:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176143.229620:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:2.0:1786176143.229626:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786176143.229628:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176143.229633:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176143.229641:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176143.229650:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87ed80 x1872931145478528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176143.229659:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145479040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176143.229678:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176143.229684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176143.229688:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176143.229691:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145478528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176143.229695:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:2.0:1786176143.229702:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176143.229708:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176143.229709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176143.229715:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786176143.229717:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176143.229722:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145478528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176143.229732:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145479168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176143.229733:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145478656:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176143.229796:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176143.229802:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176143.229806:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176143.229814:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:2.0:1786176143.229820:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176143.229827:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786176143.229827:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176143.229836:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176143.229850:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87f100 x1872931145478656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176143.229856:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145479296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176143.229876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176143.229877:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145478656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176143.229883:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176143.229887:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176143.229894:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9877
00000100:00080000:3.0:1786176143.229935:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176143.229943:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176143.229947:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176143.229951:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145478656:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176143.229954:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176143.229964:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176143.229965:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145478784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176143.229990:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145479424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176143.230008:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176143.230029:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87dc00 x1872931145478784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176143.230053:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145478784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176143.230082:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176143.230088:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176143.230092:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145478784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176143.230116:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145478912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176143.230146:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176143.230161:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87e680 x1872931145478912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176143.230176:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145478912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176143.230186:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176143.230190:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176143.230194:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145478912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176143.230201:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145479040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176143.230219:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176143.230230:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87df80 x1872931145479040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176143.230244:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145479040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176143.230254:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176143.230257:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176143.230261:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145479040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176143.230268:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145479168:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176143.230286:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176143.230297:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87c380 x1872931145479168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176143.230311:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145479168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176143.230320:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176143.230323:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176143.230327:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145479168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176143.230333:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145479296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176143.230351:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176143.230361:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87d500 x1872931145479296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176143.230374:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145479296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176143.230384:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176143.230388:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176143.230392:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145479296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176143.230398:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145479424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176143.230415:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176143.230426:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176143/real 1786176143]  req@ffff89d99e87f800 x1872931145479424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176143.230440:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145479424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176143.230450:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176143.230453:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176143.230456:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145479424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176143.741000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176143.741270:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176144.253059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176144.764989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176144.765127:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176145.277003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176145.789029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176145.789133:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176146.301053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176146.813041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176146.813132:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176147.325019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176147.837013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176147.837112:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176148.349094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176148.349107:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176148.349118:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176148.349124:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176148.349139:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9882
00000100:00080000:0.0:1786176148.349153:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176148.349165:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176148.349230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145479552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176148.349275:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176148.349280:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176148.349282:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176148.349287:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9882
00000100:00080000:0.0:1786176148.349291:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176148.349297:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176148.349309:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176148.349325:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145479552:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176148.349328:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145479680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176148.349348:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176148.349351:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176148.349353:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176148.349359:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9882
00000100:00080000:0.0:1786176148.349362:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176148.349366:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176148.349373:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176148.349388:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145479808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176148.349399:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176148.349403:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176148.349405:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176148.349410:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9882
00000800:00000100:3.0:1786176148.349419:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176148.349420:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176148.349429:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176148.349438:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176148.349462:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145479936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176148.349507:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f2a00 x1872931145479552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176148.349527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176148.349538:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176148.349543:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176148.349548:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145479552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176148.349558:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9882
00000100:00080000:3.0:1786176148.349574:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176148.349575:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176148.349591:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176148.349593:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176148.349606:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176148.349620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145479552:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176148.349629:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145480064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176148.349646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176148.349651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176148.349654:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176148.349658:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9882
00000100:00080000:0.0:1786176148.349664:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176148.349672:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176148.349676:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145479680:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176148.349679:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176148.349734:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145480192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176148.349759:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176148.349767:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000800:00000100:3.0:1786176148.349769:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176148.349774:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176148.349781:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9882
00000100:00080000:0.0:1786176148.349788:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176148.349797:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176148.349805:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176148.349815:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f2680 x1872931145479680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176148.349825:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145480320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176148.349854:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176148.349858:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145479680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176148.349861:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176148.349867:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176148.349898:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9882
00000100:00080000:0.0:1786176148.349906:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176148.349954:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176148.349966:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176148.349973:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176148.349982:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145479680:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176148.349986:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176148.350018:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145479808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176148.350030:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145480448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176148.350047:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176148.350052:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176148.350055:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786176148.350065:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176148.350066:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9882
00000100:00080000:0.0:1786176148.350080:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176148.350087:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176148.350094:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176148.350099:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f0700 x1872931145479808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176148.350116:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145480576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176148.350126:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145479808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176148.350153:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176148.350158:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176148.350164:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145479808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176148.350196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145479936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176148.350226:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176148.350238:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f2d80 x1872931145479936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176148.350250:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145479936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176148.350259:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176148.350263:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176148.350266:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145479936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176148.350272:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145480064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176148.350289:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176148.350299:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f1500 x1872931145480064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176148.350312:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145480064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176148.350321:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176148.350324:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176148.350327:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145480064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176148.350348:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145480192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176148.350366:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176148.350376:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f0e00 x1872931145480192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176148.350397:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145480192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176148.350406:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176148.350409:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176148.350412:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145480192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176148.350418:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145480320:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176148.350434:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176148.350444:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f1880 x1872931145480320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176148.350457:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145480320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176148.350466:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176148.350469:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176148.350473:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145480320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176148.350479:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145480448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176148.350516:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176148.350527:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f3480 x1872931145480448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176148.350540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145480448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176148.350558:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176148.350562:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176148.350566:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145480448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176148.350573:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145480576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176148.350589:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176148.350599:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176148/real 1786176148]  req@ffff89d9870f3100 x1872931145480576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176148.350618:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145480576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176148.350635:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176148.350640:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176148.350647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145480576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176148.861022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176148.861199:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176149.373027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176149.885008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176149.885100:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176150.396985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176150.909027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176150.909155:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176151.420970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176151.933016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176151.933168:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176152.445065:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176152.957001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176152.957150:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176153.469040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176153.469040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176153.469057:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176153.469065:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469083:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00080000:0.0:1786176153.469108:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176153.469120:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176153.469182:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145480704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176153.469225:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176153.469230:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176153.469233:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469237:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00080000:0.0:1786176153.469241:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176153.469245:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176153.469259:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176153.469275:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145480832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176153.469296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176153.469300:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176153.469303:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469311:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00080000:0.0:1786176153.469315:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176153.469318:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176153.469323:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176153.469335:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145480704:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176153.469339:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145480960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176153.469384:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176153.469387:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176153.469390:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469395:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00080000:0.0:1786176153.469398:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176153.469403:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176153.469408:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176153.469427:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145481088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176153.469436:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176153.469440:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176153.469443:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469447:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00080000:0.0:1786176153.469452:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176153.469458:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176153.469463:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176153.469478:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145481216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176153.469494:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176153.469508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176153.469515:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176153.469518:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469525:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00080000:0.0:1786176153.469538:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176153.469543:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176153.469550:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176153.469566:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145481344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176153.469580:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f3b80 x1872931145480704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176153.469584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176153.469604:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176153.469613:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469634:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00080000:0.0:1786176153.469661:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176153.469668:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176153.469677:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176153.469679:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145480704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176153.469704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145481472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176153.469709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.469737:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.469763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145480704:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176153.469786:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176153.469794:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176153.469798:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469823:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00100000:3.0:1786176153.469825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145480832:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176153.469850:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176153.469864:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176153.469875:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176153.469888:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176153.469958:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145481600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176153.469978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176153.469983:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176153.469985:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176153.469990:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9887
00000100:00080000:0.0:1786176153.469996:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176153.470004:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f0a80 x1872931145480832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176153.470005:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176153.470014:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176153.470037:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145481728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176153.470061:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145480832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176153.470082:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.470089:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.470098:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145480832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176153.470111:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145480960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176153.470153:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176153.470172:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f1180 x1872931145480960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176153.470194:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145480960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176153.470218:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.470224:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.470229:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145480960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176153.470238:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145481088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176153.470267:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176153.470285:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f3100 x1872931145481088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176153.470301:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145481088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176153.470312:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.470318:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.470322:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145481088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176153.470338:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145481216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176153.470387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176153.470413:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f3480 x1872931145481216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176153.470428:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145481216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176153.470438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.470442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.470447:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145481216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176153.470457:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145481344:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176153.470485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176153.470502:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f1880 x1872931145481344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176153.470526:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145481344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176153.470537:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.470544:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.470675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145481344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176153.470693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145481472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176153.470727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176153.470744:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f0e00 x1872931145481472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176153.470763:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145481472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176153.470776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.470784:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.470791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145481472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176153.471092:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145481600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176153.471240:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176153.471260:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f1500 x1872931145481600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176153.471277:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145481600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176153.471288:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.471292:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.471297:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145481600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176153.471305:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145481728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176153.471331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176153.471348:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176153/real 1786176153]  req@ffff89d9870f2d80 x1872931145481728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176153.471362:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145481728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176153.471373:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176153.471376:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176153.471380:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145481728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176153.981013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176153.981117:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176154.492954:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176155.005013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176155.005162:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176155.517015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176156.028952:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176156.029052:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176156.541024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176157.053031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176157.053225:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176157.564984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176158.077033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176158.077165:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176158.588962:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176158.589000:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176158.589004:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176158.589008:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176158.589016:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00080000:2.0:1786176158.589024:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176158.589030:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176158.589061:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145481856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176158.589088:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176158.589091:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176158.589093:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176158.589095:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00080000:2.0:1786176158.589098:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176158.589101:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176158.589109:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176158.589122:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145481856:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176158.589123:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145481984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176158.589137:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176158.589140:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176158.589141:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176158.589145:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00080000:2.0:1786176158.589147:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176158.589149:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176158.589153:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176158.589163:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145482112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176158.589170:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176158.589173:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176158.589174:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176158.589176:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00080000:2.0:1786176158.589179:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176158.589181:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176158.589185:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176158.589195:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145482240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176158.589195:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176158.589205:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176158.589208:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176158.589209:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176158.589213:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00080000:2.0:1786176158.589215:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176158.589217:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176158.589220:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176158.589227:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145482368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176158.589233:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176158.589236:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176158.589238:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176158.589243:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87c000 x1872931145481856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176158.589244:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00080000:2.0:1786176158.589248:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176158.589254:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176158.589260:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176158.589268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145481856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176158.589270:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145482496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176158.589297:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176158.589299:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176158.589300:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176158.589304:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176158.589308:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176158.589311:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00080000:2.0:1786176158.589315:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176158.589316:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145481856:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176158.589321:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176158.589326:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176158.589341:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145482624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176158.589343:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145481984:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176158.589360:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176158.589364:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176158.589369:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786176158.589369:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176158.589377:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00100000:3.0:1786176158.589382:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87c700 x1872931145481984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176158.589384:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176158.589393:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176158.589398:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176158.589399:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145481984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176158.589409:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786176158.589414:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145482752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176158.589414:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176158.589418:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145481984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176158.589429:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145482112:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176158.589431:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176158.589435:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176158.589437:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176158.589440:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9892
00000100:00080000:2.0:1786176158.589445:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786176158.589449:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176158.589450:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176158.589457:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176158.589463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87d880 x1872931145482112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176158.589467:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145482880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176158.589483:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145482112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176158.589495:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176158.589497:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176158.589499:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145482112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176158.589504:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145482240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176158.589517:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176158.589523:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87f800 x1872931145482240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176158.589530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145482240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176158.589536:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176158.589537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176158.589539:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145482240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176158.589543:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145482368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176158.589552:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176158.589558:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87d500 x1872931145482368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176158.589566:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145482368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176158.589570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176158.589572:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176158.589575:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145482368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176158.589578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145482496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176158.589602:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176158.589611:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87c380 x1872931145482496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176158.589618:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145482496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176158.589623:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176158.589625:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176158.589627:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145482496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176158.589639:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145482624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176158.589651:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176158.589658:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87df80 x1872931145482624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176158.589665:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145482624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176158.589670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176158.589672:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176158.589674:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145482624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176158.589677:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145482752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176158.589686:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176158.589693:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87e680 x1872931145482752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176158.589700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145482752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176158.589705:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176158.589707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176158.589708:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145482752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176158.589712:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145482880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176158.589720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176158.589726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176158/real 1786176158]  req@ffff89d99e87dc00 x1872931145482880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176158.589733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145482880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176158.589738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176158.589740:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176158.589741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145482880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176159.101017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176159.101085:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176159.613033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176160.125003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176160.125064:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176160.636998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176161.149001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176161.149050:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176161.660968:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176162.172950:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176162.173007:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176162.685005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176163.197031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176163.197108:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176163.709058:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176163.709075:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176163.709083:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176163.709100:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00100000:3.0:1786176163.709115:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176163.709126:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176163.709142:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176163.709195:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145483008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176163.709245:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176163.709251:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176163.709254:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176163.709260:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00080000:2.0:1786176163.709265:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176163.709270:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176163.709284:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176163.709314:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145483008:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176163.709316:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145483136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176163.709358:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176163.709366:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176163.709370:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176163.709380:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00080000:2.0:1786176163.709401:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176163.709408:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176163.709417:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176163.709418:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176163.709448:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145483264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176163.709463:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176163.709468:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176163.709471:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176163.709476:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00080000:2.0:1786176163.709480:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176163.709483:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176163.709490:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176163.709499:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87f100 x1872931145483008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176163.709511:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145483392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176163.709564:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176163.709580:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176163.709583:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176163.709593:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00100000:3.0:1786176163.709595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145483008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176163.709599:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176163.709621:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176163.709623:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176163.709641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786176163.709642:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176163.709655:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145483008:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176163.709669:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145483520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176163.709684:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176163.709689:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176163.709695:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176163.709696:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145483136:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176163.709711:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00080000:2.0:1786176163.709720:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176163.709728:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176163.709739:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176163.709750:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176163.709770:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145483648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176163.709778:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87ed80 x1872931145483136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176163.709835:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176163.709840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145483136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176163.709850:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176163.709860:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176163.709866:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176163.709877:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00080000:3.0:1786176163.709882:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176163.709892:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145483136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176163.709933:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145483264:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176163.709949:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176163.709962:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786176163.709969:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176163.709977:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176163.709991:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87ca80 x1872931145483264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176163.710007:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145483776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176163.710069:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145483264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176163.710070:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176163.710088:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176163.710097:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176163.710111:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176163.710117:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00080000:3.0:1786176163.710123:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176163.710132:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145483264:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176163.710134:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176163.710147:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145483392:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176163.710148:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176163.710162:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176163.710190:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145483904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176163.710205:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786176163.710215:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176163.710216:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176163.710222:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176163.710232:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9897
00000100:00080000:2.0:1786176163.710240:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176163.710244:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176163.710251:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176163.710257:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87dc00 x1872931145483392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176163.710271:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145484032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176163.710291:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145483392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176163.710305:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176163.710310:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176163.710315:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145483392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176163.710328:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145483520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176163.710357:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176163.710371:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87e680 x1872931145483520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176163.710385:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145483520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176163.710403:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176163.710407:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176163.710411:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145483520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176163.710434:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145483648:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176163.710455:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176163.710466:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87df80 x1872931145483648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176163.710480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145483648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176163.710491:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176163.710494:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176163.710498:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145483648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176163.710505:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145483776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176163.710523:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176163.710534:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87c380 x1872931145483776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176163.710594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145483776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176163.710611:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176163.710615:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176163.710621:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145483776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176163.710629:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145483904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176163.710657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176163.710671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87d500 x1872931145483904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176163.710685:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145483904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176163.710695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176163.710698:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176163.710702:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145483904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176163.710709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145484032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176163.710727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176163.710737:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176163/real 1786176163]  req@ffff89d99e87f800 x1872931145484032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176163.710751:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145484032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176163.710761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176163.710764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176163.710768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145484032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176164.221072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176164.221203:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176164.733025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176165.244976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176165.245116:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176165.757020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176166.269054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176166.269203:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176166.780964:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176167.292968:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176167.293031:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176167.805032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176168.316964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176168.317094:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176168.828974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176168.829025:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829031:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176168.829034:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829043:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829052:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176168.829058:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176168.829092:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145484160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176168.829115:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829118:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176168.829119:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829121:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829123:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176168.829126:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176168.829134:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176168.829143:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145484288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176168.829147:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145484160:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176168.829156:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829159:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176168.829160:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829163:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829166:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176168.829169:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176168.829173:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176168.829182:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145484416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176168.829189:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829191:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176168.829193:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829195:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829198:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176168.829200:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176168.829204:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176168.829212:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145484544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176168.829216:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176168.829224:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829227:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176168.829236:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829240:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829243:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176168.829246:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176168.829250:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176168.829257:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145484672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176168.829263:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f0700 x1872931145484160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176168.829284:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829288:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176168.829290:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829293:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829296:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176168.829297:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145484160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176168.829301:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176168.829308:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176168.829313:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176168.829318:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145484800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176168.829320:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829329:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145484160:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176168.829332:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829335:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176168.829336:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829340:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829342:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176168.829344:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176168.829346:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176168.829352:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145484288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176168.829355:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145484928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176168.829364:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829366:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176168.829367:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829370:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829374:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786176168.829376:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176168.829379:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176168.829384:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176168.829392:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f2680 x1872931145484288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176168.829394:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145485056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176168.829422:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176168.829426:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786176168.829427:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145484288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176168.829428:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176168.829435:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9903
00000100:00080000:0.0:1786176168.829440:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176168.829445:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176168.829446:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176168.829449:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176168.829451:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829456:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145484288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176168.829458:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145485184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176168.829465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145484416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176168.829485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176168.829518:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f2a00 x1872931145484416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176168.829526:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145484416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176168.829532:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176168.829534:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829536:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145484416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176168.829540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145484544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176168.829553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176168.829559:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f2d80 x1872931145484544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176168.829566:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145484544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176168.829571:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176168.829573:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829575:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145484544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176168.829578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145484672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176168.829588:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176168.829594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f1500 x1872931145484672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176168.829601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145484672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176168.829606:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176168.829608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829616:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145484672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176168.829620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145484800:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176168.829631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176168.829637:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f0e00 x1872931145484800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176168.829645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145484800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176168.829650:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176168.829651:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829653:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145484800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176168.829665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145484928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176168.829675:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176168.829681:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f1880 x1872931145484928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176168.829688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145484928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176168.829693:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176168.829695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145484928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176168.829701:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145485056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176168.829709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176168.829715:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f3480 x1872931145485056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176168.829722:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145485056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176168.829728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176168.829729:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829731:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145485056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176168.829734:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145485184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176168.829743:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176168.829748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176168/real 1786176168]  req@ffff89d9870f3100 x1872931145485184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176168.829754:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145485184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176168.829759:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176168.829761:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176168.829763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145485184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176169.340987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176169.341086:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176169.853026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176170.365007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176170.365064:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176170.876979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176171.388984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176171.389054:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176171.901061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176172.413011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176172.413065:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176172.924987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176173.437050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176173.437169:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176173.949017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176173.949068:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176173.949075:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176173.949079:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176173.949088:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00080000:2.0:1786176173.949098:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176173.949105:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176173.949155:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145485312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176173.949191:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176173.949196:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176173.949199:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176173.949205:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00080000:2.0:1786176173.949216:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176173.949224:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176173.949234:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145485312:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176173.949236:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176173.949257:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145485440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176173.949270:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176173.949273:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176173.949275:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176173.949279:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00080000:2.0:1786176173.949293:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176173.949297:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176173.949303:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176173.949308:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176173.949320:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145485568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176173.949331:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176173.949334:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176173.949336:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176173.949339:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00080000:2.0:1786176173.949343:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176173.949346:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176173.949350:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176173.949362:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87d880 x1872931145485312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176173.949364:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145485696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176173.949407:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176173.949411:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176173.949413:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176173.949418:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145485312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176173.949422:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00080000:2.0:1786176173.949430:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176173.949461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176173.949465:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176173.949468:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176173.949475:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145485312:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176173.949476:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176173.949497:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145485824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176173.949509:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176173.949510:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145485440:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176173.949518:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176173.949522:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176173.949527:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00080000:2.0:1786176173.949531:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176173.949537:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176173.949542:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176173.949547:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176173.949559:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145485952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176173.949567:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87c700 x1872931145485440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176173.949575:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176173.949585:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176173.949589:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176173.949596:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00100000:3.0:1786176173.949601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145485440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176173.949603:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176173.949612:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176173.949621:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176173.949624:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176173.949631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176173.949636:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145486080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176173.949641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145485440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176173.949657:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145485568:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176173.949659:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176173.949667:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176173.949669:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176173.949674:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00080000:2.0:1786176173.949681:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786176173.949687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176173.949688:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176173.949697:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176173.949706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87c000 x1872931145485568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176173.949713:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145486208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176173.949727:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145485568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176173.949730:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176173.949742:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176173.949746:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176173.949751:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176173.949753:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9908
00000100:00080000:2.0:1786176173.949761:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176173.949762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176173.949768:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176173.949773:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145485568:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176173.949777:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176173.949783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145485696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176173.949791:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145486336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176173.949808:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176173.949821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87f800 x1872931145485696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176173.949832:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145485696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176173.949839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176173.949841:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176173.949844:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145485696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176173.949857:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145485824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176173.949870:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176173.949878:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87d500 x1872931145485824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176173.949888:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145485824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176173.949894:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176173.949920:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176173.949923:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145485824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176173.949928:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145485952:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176173.949944:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176173.949954:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87c380 x1872931145485952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176173.949964:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145485952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176173.949971:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176173.949973:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176173.949976:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145485952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176173.949981:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145486080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176173.949992:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176173.950001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87df80 x1872931145486080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176173.950011:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145486080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176173.950017:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176173.950019:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176173.950022:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145486080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176173.950026:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145486208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176173.950039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176173.950052:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87e680 x1872931145486208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176173.950067:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145486208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176173.950078:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176173.950082:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176173.950087:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145486208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176173.950095:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145486336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176173.950122:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176173.950134:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176173/real 1786176173]  req@ffff89d99e87dc00 x1872931145486336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176173.950144:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145486336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176173.950152:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176173.950155:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176173.950158:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145486336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176174.461020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176174.461078:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176174.973020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176175.485034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176175.485103:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176175.997014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176176.509037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176176.509232:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176177.021020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176177.532968:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176177.533114:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176178.045029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176178.556994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176178.557088:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176179.069069:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176179.069083:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176179.069090:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176179.069096:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176179.069105:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9913
00000100:00080000:2.0:1786176179.069121:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176179.069132:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176179.069182:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145486464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176179.069230:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176179.069235:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176179.069238:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176179.069243:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9913
00000100:00080000:2.0:1786176179.069247:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176179.069263:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176179.069276:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176179.069296:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145486592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176179.069304:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145486464:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176179.069325:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176179.069331:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176179.069333:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176179.069346:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9913
00000100:00080000:2.0:1786176179.069349:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176179.069354:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176179.069361:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176179.069375:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145486720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176179.069415:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176179.069422:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176179.069425:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176179.069430:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9913
00000100:00080000:2.0:1786176179.069438:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176179.069444:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176179.069452:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176179.069461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176179.069495:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145486848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176179.069518:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176179.069527:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176179.069531:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176179.069541:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9913
00000100:00100000:3.0:1786176179.069545:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87ca80 x1872931145486464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176179.069555:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176179.069581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145486464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176179.069594:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176179.069606:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176179.069608:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176179.069618:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176179.069626:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145486464:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176179.069639:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145486976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176179.069658:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176179.069664:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145486592:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176179.069667:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176179.069676:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176179.069685:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9913
00000100:00080000:2.0:1786176179.069691:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176179.069698:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176179.069705:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176179.069714:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176179.069725:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145487104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176179.069741:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87ed80 x1872931145486592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176179.069742:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176179.069758:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176179.069763:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176179.069778:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9913
00000100:00100000:3.0:1786176179.069786:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145486592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176179.069797:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176179.069801:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176179.069810:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176179.069817:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786176179.069824:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176179.069831:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145486592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176179.069855:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145487232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176179.069856:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145486720:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176179.069963:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786176179.069965:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176179.069975:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176179.069979:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176179.069988:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9913
00000100:00100000:3.0:1786176179.069995:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87f100 x1872931145486720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176179.070000:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176179.070026:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176179.070036:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145486720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176179.070037:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176179.070060:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176179.070071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176179.070072:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145487360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176179.070079:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145486720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176179.070103:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145486848:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176179.070109:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176179.070116:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176179.070118:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176179.070125:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9913
00000800:00000100:3.0:1786176179.070141:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176179.070143:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176179.070153:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176179.070162:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176179.070163:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87dc00 x1872931145486848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176179.070187:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145487488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176179.070201:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145486848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176179.070224:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176179.070232:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176179.070240:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145486848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176179.070287:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145486976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176179.070318:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176179.070335:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87e680 x1872931145486976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176179.070359:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145486976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176179.070375:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176179.070381:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176179.070415:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145486976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176179.070430:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145487104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176179.070480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176179.070497:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87df80 x1872931145487104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176179.070513:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145487104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176179.070524:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176179.070527:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176179.070532:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145487104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176179.070540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145487232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176179.070560:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176179.070572:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87c380 x1872931145487232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176179.070586:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145487232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176179.070595:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176179.070599:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176179.070602:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145487232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176179.070609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145487360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176179.070626:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176179.070636:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87d500 x1872931145487360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176179.070649:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145487360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176179.070658:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176179.070662:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176179.070666:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145487360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176179.070672:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145487488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176179.070689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176179.070700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176179/real 1786176179]  req@ffff89d99e87f800 x1872931145487488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176179.070714:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145487488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176179.070724:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176179.070727:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176179.070731:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145487488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176179.581012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176179.581093:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176180.093007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176180.605053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176180.605138:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176181.116968:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176181.628993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176181.629089:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176182.141025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176182.653010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176182.653087:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176183.164952:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176183.676972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176183.677052:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176184.189058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176184.189076:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176184.189095:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176184.189101:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176184.189117:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9918
00000100:00080000:0.0:1786176184.189130:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176184.189152:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176184.189212:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145487616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176184.189253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176184.189257:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176184.189259:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176184.189262:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9918
00000100:00080000:0.0:1786176184.189266:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176184.189269:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176184.189280:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176184.189293:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145487744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176184.189302:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176184.189305:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176184.189308:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176184.189311:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9918
00000100:00080000:0.0:1786176184.189313:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176184.189316:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176184.189322:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176184.189335:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145487872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176184.189364:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145487616:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176184.189368:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176184.189383:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176184.189387:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176184.189393:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9918
00000100:00080000:0.0:1786176184.189396:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176184.189399:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176184.189406:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176184.189439:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145488000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176184.189468:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176184.189475:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176184.189478:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176184.189483:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9918
00000100:00080000:0.0:1786176184.189490:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786176184.189502:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176184.189505:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176184.189532:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176184.189550:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145488128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176184.189563:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176184.189566:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176184.189569:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176184.189573:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9918
00000100:00080000:0.0:1786176184.189581:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176184.189587:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176184.189594:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176184.189625:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145488256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176184.189627:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f1180 x1872931145487616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176184.189690:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176184.189696:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176184.189699:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176184.189705:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145487616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176184.189707:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9918
00000100:00080000:0.0:1786176184.189720:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176184.189736:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176184.189746:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176184.189748:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176184.189759:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.189765:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145487616:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176184.189775:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145487744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176184.189797:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145488384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176184.189807:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176184.189810:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176184.189813:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176184.189819:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9918
00000800:00000100:3.0:1786176184.189826:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176184.189828:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176184.189837:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176184.189845:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176184.189852:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f0a80 x1872931145487744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176184.189865:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145488512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176184.189890:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176184.189892:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145487744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176184.189895:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176184.189898:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176184.189901:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9918
00000100:00080000:0.0:1786176184.189904:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176184.189908:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176184.189976:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176184.189981:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176184.189998:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145488640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176184.189999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.190032:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145487744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176184.190078:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145487872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176184.190115:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176184.190132:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f3b80 x1872931145487872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176184.190169:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145487872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176184.190178:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176184.190181:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.190185:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145487872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176184.190191:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145488000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176184.190210:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176184.190239:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f3100 x1872931145488000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176184.190262:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145488000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176184.190276:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176184.190299:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.190306:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145488000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176184.190318:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145488128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176184.190399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176184.190418:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f3480 x1872931145488128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176184.190471:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145488128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176184.190486:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176184.190492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.190498:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145488128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176184.190528:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145488256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176184.190564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176184.190597:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f1880 x1872931145488256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176184.190623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145488256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176184.190640:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176184.190644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.190647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145488256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176184.190655:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145488384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176184.190687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176184.190697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f0e00 x1872931145488384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176184.190710:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145488384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176184.190719:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176184.190723:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.190726:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145488384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176184.190742:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145488512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176184.190759:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176184.190768:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f1500 x1872931145488512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176184.190781:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145488512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176184.190790:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176184.190793:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.190807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145488512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176184.190813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145488640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176184.190831:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176184.190840:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176184/real 1786176184]  req@ffff89d9870f2d80 x1872931145488640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176184.190852:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145488640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176184.190861:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176184.190865:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176184.190869:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145488640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176184.700989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176184.701164:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176185.212995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176185.725021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176185.725095:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176186.236993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176186.748986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176186.749090:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176187.261073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176187.773013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176187.773084:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176188.285004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176188.797031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176188.797064:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176189.309107:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176189.309126:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.309137:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176189.309144:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.309157:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00080000:3.0:1786176189.309172:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176189.309185:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176189.309241:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145488768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176189.309320:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.309330:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176189.309335:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.309346:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00080000:3.0:1786176189.309354:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176189.309362:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176189.309376:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176189.309382:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145488768:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176189.309408:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145488896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176189.309430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.309436:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176189.309440:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.309445:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00080000:3.0:1786176189.309464:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176189.309470:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176189.309477:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176189.309496:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145489024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176189.309510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.309515:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176189.309518:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.309537:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00080000:3.0:1786176189.309544:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176189.309549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176189.309559:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176189.309565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145488896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176189.309582:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145489152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176189.309638:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145489024:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176189.310012:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.310020:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176189.310026:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.310037:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00080000:3.0:1786176189.310048:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176189.310059:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176189.310074:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176189.310079:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145489152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176189.310110:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145489280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176189.310135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.310144:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176189.310148:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.310156:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00080000:3.0:1786176189.310165:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176189.310179:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145489280:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176189.310191:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176189.310205:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176189.310234:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145489408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176189.310267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.310275:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176189.310280:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.310316:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00100000:1.0:1786176189.310324:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145489408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176189.310326:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176189.310341:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176189.310356:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176189.310381:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145489536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176189.310402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.310409:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176189.310413:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.310428:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00100000:1.0:1786176189.310429:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145489536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176189.310437:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176189.310451:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176189.310463:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176189.310490:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145489664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176189.310521:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176189.310529:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176189.310533:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176189.310542:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9923
00000100:00080000:3.0:1786176189.310551:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176189.310560:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176189.310571:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176189.310574:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145489664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176189.310604:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145489792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176189.310684:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145489792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176189.821117:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176189.821240:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176190.332976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176190.845010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176190.845106:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176191.357017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176191.869002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176191.869140:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176192.381033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786176192.381389:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786176192.381439:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786176192.381458:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176192.381528:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786176192.381558:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176192.381581:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176192.381582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe64000 x1872931145489792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176192.381611:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176192.381653:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145489792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176192.381665:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176192.381691:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176192.381695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.381713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000800:00000100:2.0:1786176192.381715:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176192.381735:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145489792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176192.381751:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176192.381766:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe64380 x1872931145489536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176192.381801:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145489536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176192.381817:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.381824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176192.381831:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145489536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176192.381844:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe65180 x1872931145489408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176192.381882:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145489408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176192.381989:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.381999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176192.382007:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145489408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176192.382020:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe67b80 x1872931145489280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176192.382045:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145489280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176192.382077:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.382084:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176192.382090:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145489280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176192.382102:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe65f80 x1872931145489152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176192.382121:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145489152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176192.382134:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.382139:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176192.382145:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145489152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176192.382155:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe64700 x1872931145488896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176192.382178:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145488896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176192.382192:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.382198:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176192.382204:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145488896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176192.382215:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe66300 x1872931145489024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176192.382236:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145489024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176192.382248:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.382254:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176192.382287:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145489024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176192.382302:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe66d80 x1872931145488768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176192.382326:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145488768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176192.382340:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.382345:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176192.382351:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145488768:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176192.382405:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176189/real 1786176192]  req@ffff89d99fe67800 x1872931145489664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176192.382428:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145489664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176192.382442:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176192.382447:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176192.382453:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145489664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176192.893000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176192.893157:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176193.405003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176193.916997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176193.917065:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176194.428978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176194.428979:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176194.428987:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176194.428991:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176194.428998:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9928
00000100:00080000:0.0:1786176194.429007:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176194.429013:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176194.429044:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145489920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176194.429067:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176194.429070:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176194.429071:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176194.429074:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9928
00000100:00080000:0.0:1786176194.429076:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176194.429079:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176194.429087:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176194.429096:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145490048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176194.429101:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145489920:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176194.429113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176194.429116:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176194.429117:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176194.429120:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9928
00000100:00080000:0.0:1786176194.429122:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176194.429124:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176194.429128:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176194.429137:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145490176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176194.429143:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176194.429145:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176194.429148:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176194.429150:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9928
00000100:00080000:0.0:1786176194.429152:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176194.429154:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176194.429159:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176194.429160:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176194.429175:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145490304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176194.429186:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176194.429190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176194.429192:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176194.429197:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9928
00000100:00100000:1.0:1786176194.429202:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f2a00 x1872931145489920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176194.429208:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176194.429219:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176194.429224:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176194.429230:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145489920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176194.429236:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145490432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176194.429262:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176194.429264:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176194.429271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176194.429272:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176194.429275:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176194.429282:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145489920:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176194.429284:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9928
00000100:00080000:0.0:1786176194.429293:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176194.429298:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176194.429304:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176194.429315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145490048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176194.429320:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145490560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176194.429333:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176194.429337:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176194.429340:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176194.429346:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9928
00000800:00000100:1.0:1786176194.429350:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176194.429356:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176194.429362:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176194.429368:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176194.429375:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f2680 x1872931145490048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176194.429384:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145490688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176194.429395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176194.429398:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145490048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176194.429399:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176194.429403:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176194.429411:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9928
00000100:00080000:1.0:1786176194.429422:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176194.429424:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176194.429429:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176194.429430:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176194.429437:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176194.429438:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145490048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176194.429448:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145490816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176194.429450:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145490176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176194.429467:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176194.429472:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176194.429474:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176194.429483:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9928
00000800:00000100:1.0:1786176194.429484:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176194.429491:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176194.429499:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176194.429504:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f0700 x1872931145490176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176194.429506:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176194.429528:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145490176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176194.429529:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145490944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176194.429555:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176194.429561:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176194.429566:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145490176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176194.429574:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145490304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176194.429596:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176194.429606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f2d80 x1872931145490304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176194.429617:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145490304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176194.429624:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176194.429627:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176194.429631:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145490304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176194.429636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145490432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176194.429653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176194.429664:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f1500 x1872931145490432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176194.429675:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145490432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176194.429682:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176194.429685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176194.429688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145490432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176194.429706:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145490560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176194.429725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176194.429737:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f0e00 x1872931145490560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176194.429748:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145490560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176194.429756:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176194.429759:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176194.429763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145490560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176194.429768:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145490688:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176194.429786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176194.429798:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f1880 x1872931145490688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176194.429810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145490688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176194.429818:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176194.429821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176194.429825:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145490688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176194.429831:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145490816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176194.429852:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176194.429863:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f3480 x1872931145490816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176194.429876:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145490816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176194.429885:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176194.429888:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176194.429892:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145490816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176194.429924:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145490944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176194.429946:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176194.429960:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176194/real 1786176194]  req@ffff89d9870f3100 x1872931145490944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176194.429972:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145490944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176194.429982:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176194.429987:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176194.429990:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145490944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176194.941047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176194.941169:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176195.453049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176195.965015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176195.965144:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176196.477007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176196.989034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176196.989161:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176197.501060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176198.012983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176198.013098:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176198.525045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176199.037052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176199.037123:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176199.548999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176199.549025:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176199.549032:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176199.549036:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549046:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00080000:1.0:1786176199.549054:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176199.549060:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176199.549095:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145491072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176199.549121:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176199.549124:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176199.549126:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549129:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00080000:1.0:1786176199.549132:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176199.549135:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176199.549144:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176199.549168:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145491200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176199.549168:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145491072:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176199.549189:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176199.549207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176199.549209:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549213:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00080000:1.0:1786176199.549216:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176199.549220:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176199.549224:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176199.549236:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145491328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176199.549254:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176199.549258:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176199.549260:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549262:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00080000:1.0:1786176199.549264:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176199.549267:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176199.549270:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786176199.549277:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176199.549280:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145491456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176199.549289:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176199.549291:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176199.549293:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549296:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00080000:1.0:1786176199.549299:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176199.549302:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176199.549305:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176199.549314:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145491584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176199.549322:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176199.549322:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2fdf80 x1872931145491072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176199.549330:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176199.549334:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549343:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00080000:1.0:1786176199.549346:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176199.549349:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176199.549353:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176199.549354:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145491072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176199.549365:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145491712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176199.549365:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.549373:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.549380:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145491072:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176199.549390:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176199.549395:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176199.549398:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549404:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00100000:2.0:1786176199.549408:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145491200:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176199.549411:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176199.549420:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176199.549425:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176199.549433:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176199.549439:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145491840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176199.549451:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2fe300 x1872931145491200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176199.549457:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176199.549464:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176199.549468:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549475:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00080000:1.0:1786176199.549479:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176199.549498:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145491200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176199.549504:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176199.549516:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786176199.549520:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.549526:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.549531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145491200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176199.549538:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145491968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176199.549544:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145491328:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176199.549570:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176199.549574:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176199.549576:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176199.549582:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9933
00000100:00080000:1.0:1786176199.549587:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786176199.549592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176199.549597:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176199.549604:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176199.549620:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145492096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176199.549644:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2fe680 x1872931145491328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176199.549666:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145491328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176199.549673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.549677:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.549681:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145491328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176199.549688:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145491456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176199.549713:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176199.549727:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2fdc00 x1872931145491456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176199.549740:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145491456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176199.549747:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.549751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.549755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145491456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176199.549762:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145491584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176199.549785:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176199.549798:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2ff480 x1872931145491584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176199.549815:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145491584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176199.549820:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.549823:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.549825:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145491584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176199.549829:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145491712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176199.549845:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176199.549852:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2fd880 x1872931145491712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176199.549860:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145491712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176199.549865:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.549867:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.549869:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145491712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176199.549886:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145491840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176199.549921:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176199.549930:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2fce00 x1872931145491840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176199.549938:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145491840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176199.549949:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.549951:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.549954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145491840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176199.549957:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145491968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176199.549970:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176199.549976:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2fc700 x1872931145491968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176199.549984:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145491968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176199.549989:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.549991:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.549993:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145491968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176199.549997:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145492096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176199.550007:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176199.550013:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176199/real 1786176199]  req@ffff89d9ba2fdf80 x1872931145492096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176199.550031:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145492096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176199.550036:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176199.550038:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176199.550041:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145492096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176200.061020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176200.061101:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176200.573070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176201.084981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176201.085079:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176201.597043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176202.109083:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176202.109155:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176202.621042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176203.133018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176203.133083:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176203.645070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176204.156959:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176204.157026:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176204.669035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176204.669055:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176204.669067:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176204.669073:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176204.669087:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9938
00000100:00080000:1.0:1786176204.669101:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176204.669111:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176204.669185:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145492224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176204.669215:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176204.669220:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176204.669222:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176204.669226:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9938
00000100:00080000:1.0:1786176204.669230:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176204.669236:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176204.669248:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176204.669267:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145492352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176204.669267:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145492224:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176204.669295:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176204.669300:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176204.669302:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176204.669309:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9938
00000100:00080000:1.0:1786176204.669313:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176204.669318:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176204.669323:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176204.669337:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145492480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176204.669347:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786176204.669352:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176204.669361:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176204.669364:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176204.669372:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9938
00000100:00080000:1.0:1786176204.669379:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176204.669384:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176204.669391:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176204.669401:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2fd180 x1872931145492224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176204.669409:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145492608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176204.669431:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145492224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176204.669432:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176204.669454:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176204.669466:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176204.669468:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176204.669481:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176204.669482:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9938
00000100:00080000:1.0:1786176204.669494:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176204.669500:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145492224:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176204.669505:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176204.669518:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176204.669534:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145492736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176204.669541:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145492352:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176204.669568:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176204.669573:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176204.669576:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176204.669583:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9938
00000800:00000100:2.0:1786176204.669589:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176204.669595:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176204.669604:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176204.669612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2fed80 x1872931145492352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176204.669614:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176204.669639:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145492864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176204.669647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145492352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176204.669660:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176204.669676:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176204.669679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176204.669680:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176204.669693:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176204.669698:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9938
00000100:00100000:2.0:1786176204.669704:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145492352:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176204.669707:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176204.669714:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145492480:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176204.669716:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176204.669732:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176204.669749:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176204.669757:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145492992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176204.669764:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2ffb80 x1872931145492480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176204.669795:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176204.669802:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176204.669804:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176204.669810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145492480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176204.669816:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9938
00000100:00080000:1.0:1786176204.669827:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176204.669836:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176204.669837:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786176204.669847:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786176204.669852:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176204.669853:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145492480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176204.669870:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145492608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176204.669880:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145493120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176204.669922:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176204.669935:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2ff100 x1872931145492608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176204.669941:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176204.669946:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145492608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176204.669950:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176204.669962:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176204.669966:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176204.669972:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176204.669978:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9938
00000100:00100000:2.0:1786176204.669983:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145492608:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786176204.669990:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176204.669999:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176204.670005:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176204.670009:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145492736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176204.670029:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145493248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176204.670039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176204.670052:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2fea00 x1872931145492736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176204.670067:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145492736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176204.670073:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176204.670076:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176204.670081:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145492736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176204.670088:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145492864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176204.670100:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176204.670106:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2fd500 x1872931145492864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176204.670113:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145492864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176204.670118:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176204.670120:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176204.670122:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145492864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176204.670125:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145492992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176204.670135:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176204.670156:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2fc380 x1872931145492992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176204.670166:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145492992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176204.670171:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176204.670173:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176204.670176:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145492992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176204.670180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145493120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176204.670194:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176204.670201:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2ff800 x1872931145493120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176204.670209:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145493120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176204.670216:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176204.670219:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176204.670222:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145493120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176204.670242:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145493248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176204.670263:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176204.670274:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176204/real 1786176204]  req@ffff89d9ba2ff100 x1872931145493248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176204.670283:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145493248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176204.670288:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176204.670290:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176204.670293:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145493248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176205.181007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176205.181207:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176205.692983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176206.204980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176206.205093:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176206.717004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176207.228999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176207.229059:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176207.740971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176208.253003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176208.253181:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176208.765049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176209.277019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176209.277171:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176209.788970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176209.788975:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.788981:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176209.788985:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176209.788993:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789001:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176209.789008:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176209.789052:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145493376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176209.789073:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.789076:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176209.789078:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176209.789081:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789083:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176209.789086:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176209.789107:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176209.789119:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145493504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176209.789135:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145493376:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176209.789139:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.789142:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176209.789144:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176209.789148:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789151:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176209.789153:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176209.789157:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176209.789167:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145493632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176209.789173:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.789176:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176209.789177:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176209.789180:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789182:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176209.789184:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176209.789187:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786176209.789192:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176209.789196:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145493760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176209.789204:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.789207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176209.789208:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176209.789211:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789214:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176209.789216:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176209.789219:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176209.789231:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145493888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176209.789231:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2ffb80 x1872931145493376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176209.789256:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.789266:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176209.789267:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176209.789269:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789270:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176209.789275:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176209.789279:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176209.789285:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145493376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176209.789288:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145494016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176209.789310:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176209.789311:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.789318:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176209.789320:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176209.789321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176209.789326:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145493376:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176209.789327:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789335:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176209.789337:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176209.789340:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176209.789346:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145494144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176209.789352:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145493504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176209.789360:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.789364:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176209.789365:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176209.789369:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789373:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786176209.789377:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176209.789381:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176209.789386:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176209.789392:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2fed80 x1872931145493504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176209.789396:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145494272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176209.789417:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176209.789421:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176209.789422:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176209.789426:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145493504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176209.789428:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9944
00000100:00080000:1.0:1786176209.789433:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176209.789439:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176209.789444:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786176209.789448:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176209.789453:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145494400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176209.789457:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176209.789468:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145493504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176209.789477:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145493632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176209.789496:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176209.789507:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2fd180 x1872931145493632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176209.789516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145493632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176209.789522:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176209.789524:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176209.789527:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145493632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176209.789533:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145493760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176209.789551:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176209.789563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2fdf80 x1872931145493760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176209.789576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145493760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176209.789585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176209.789587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176209.789589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145493760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176209.789594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145493888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176209.789609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176209.789617:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2fc700 x1872931145493888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176209.789625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145493888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176209.789629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176209.789631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176209.789633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145493888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176209.789636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145494016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176209.789646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176209.789652:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2fce00 x1872931145494016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176209.789660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145494016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176209.789665:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176209.789666:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176209.789668:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145494016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176209.789683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145494144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176209.789693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176209.789699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2fd880 x1872931145494144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176209.789707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145494144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176209.789712:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176209.789714:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176209.789716:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145494144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176209.789719:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145494272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176209.789729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176209.789734:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2ff480 x1872931145494272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176209.789741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145494272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176209.789746:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176209.789748:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176209.789750:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145494272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176209.789754:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145494400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176209.789773:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176209.789779:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176209/real 1786176209]  req@ffff89d9ba2fdc00 x1872931145494400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176209.789791:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145494400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176209.789800:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176209.789803:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176209.789807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145494400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176210.301010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176210.301078:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176210.813057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176211.324964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176211.325035:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176211.836948:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176212.348965:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176212.349046:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176212.861036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176213.372983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176213.373109:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176213.885083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176214.397029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176214.397131:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176214.909103:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176214.909175:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176214.909187:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176214.909193:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176214.909207:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00080000:2.0:1786176214.909228:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176214.909238:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176214.909296:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145494528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176214.909341:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176214.909347:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176214.909350:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176214.909355:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00080000:2.0:1786176214.909360:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176214.909365:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176214.909378:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176214.909407:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145494528:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176214.909408:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145494656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176214.909439:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176214.909442:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176214.909446:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176214.909454:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00080000:2.0:1786176214.909458:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176214.909463:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176214.909468:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176214.909485:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145494784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176214.909495:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176214.909499:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176214.909500:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176214.909503:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00080000:2.0:1786176214.909509:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176214.909516:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176214.909523:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176214.909531:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176214.909546:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145494912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176214.909554:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176214.909557:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176214.909558:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176214.909564:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00080000:2.0:1786176214.909567:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176214.909570:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176214.909574:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176214.909588:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145495040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176214.909595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87c000 x1872931145494528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176214.909601:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176214.909611:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176214.909617:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176214.909625:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00080000:2.0:1786176214.909635:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176214.909654:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176214.909660:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176214.909662:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145494528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176214.909679:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145495168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176214.909682:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176214.909704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176214.909719:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176214.909724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145494528:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176214.909726:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176214.909734:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176214.909743:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00080000:2.0:1786176214.909747:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176214.909754:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176214.909759:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176214.909772:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145495296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176214.909776:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145494656:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176214.909810:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176214.909814:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176214.909817:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176214.909824:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00080000:2.0:1786176214.909827:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176214.909832:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176214.909837:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176214.909840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176214.909861:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145495424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176214.909872:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87c700 x1872931145494656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176214.909886:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176214.909942:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145494656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176214.909953:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176214.909956:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176214.909960:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176214.909961:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176214.909982:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9949
00000100:00100000:1.0:1786176214.909984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145494656:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176214.909991:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176214.909999:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176214.910000:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145494784:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176214.910014:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176214.910032:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145495552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176214.910068:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176214.910093:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87d880 x1872931145494784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176214.910107:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145494784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176214.910122:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176214.910126:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176214.910130:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145494784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176214.910138:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145494912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176214.910160:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176214.910169:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87f800 x1872931145494912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176214.910180:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145494912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176214.910188:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176214.910191:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176214.910194:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145494912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176214.910200:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145495040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176214.910215:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176214.910224:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87d500 x1872931145495040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176214.910235:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145495040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176214.910242:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176214.910245:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176214.910249:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145495040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176214.910254:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145495168:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176214.910276:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176214.910302:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87c380 x1872931145495168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176214.910323:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145495168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176214.910336:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176214.910341:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176214.910346:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145495168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176214.910379:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145495296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176214.910414:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176214.910429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87df80 x1872931145495296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176214.910465:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145495296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176214.910475:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176214.910479:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176214.910483:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145495296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176214.910491:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145495424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176214.910514:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176214.910527:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87e680 x1872931145495424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176214.910548:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145495424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176214.910582:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176214.910587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176214.910592:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145495424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176214.910602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145495552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176214.910634:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176214.910651:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176214/real 1786176214]  req@ffff89d99e87dc00 x1872931145495552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176214.910665:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145495552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176214.910674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176214.910677:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176214.910680:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145495552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176215.420988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176215.421248:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176215.933095:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176216.444988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176216.445085:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176216.956977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176217.469096:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176217.469176:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176217.981034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176218.492984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176218.493166:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176219.004997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176219.517083:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176219.517231:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176220.028973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176220.029094:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176220.029107:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176220.029113:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176220.029127:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00080000:2.0:1786176220.029142:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176220.029152:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176220.029209:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145495680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176220.029266:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176220.029272:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176220.029274:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176220.029280:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00080000:2.0:1786176220.029289:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176220.029296:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176220.029311:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176220.029315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145495680:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176220.029335:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145495808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176220.029370:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176220.029375:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176220.029378:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176220.029394:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176220.029399:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00080000:2.0:1786176220.029409:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176220.029415:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176220.029423:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176220.029448:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87f100 x1872931145495680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176220.029451:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145495936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176220.029503:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145495680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176220.029512:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176220.029517:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176220.029524:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176220.029531:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176220.029554:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176220.029558:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00100000:1.0:1786176220.029568:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145495680:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176220.029569:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176220.029584:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176220.029596:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176220.029605:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145495808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176220.029623:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145496064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176220.029639:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176220.029660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87ed80 x1872931145495808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176220.029660:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176220.029678:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176220.029687:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176220.029693:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145495808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176220.029702:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00080000:1.0:1786176220.029718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176220.029721:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176220.029723:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176220.029734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145495808:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176220.029742:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176220.029747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145495936:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176220.029761:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176220.029771:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176220.029781:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87ca80 x1872931145495936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176220.029789:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145496192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176220.029805:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145495936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176220.029825:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176220.029827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176220.029838:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176220.029844:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176220.029845:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176220.029869:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00100000:1.0:1786176220.029870:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145495936:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176220.029884:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176220.029893:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176220.029901:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176220.029915:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145496320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176220.029932:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145496064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176220.029952:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176220.029966:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87f100 x1872931145496064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176220.029968:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176220.029983:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176220.029986:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176220.029987:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145496064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176220.030026:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00080000:1.0:1786176220.030027:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176220.030041:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176220.030042:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176220.030057:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145496064:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176220.030061:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176220.030075:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176220.030076:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145496192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176220.030110:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145496448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176220.030124:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176220.030141:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176220.030150:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87dc00 x1872931145496192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176220.030150:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176220.030157:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176220.030179:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00100000:1.0:1786176220.030186:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145496192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176220.030187:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176220.030203:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176220.030214:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176220.030218:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176220.030230:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176220.030232:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145496576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176220.030247:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145496192:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176220.030253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176220.030266:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176220.030268:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176220.030276:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9954
00000100:00080000:2.0:1786176220.030280:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176220.030284:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176220.030292:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145496320:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176220.030293:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176220.030322:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145496704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176220.030338:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176220.030355:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87e680 x1872931145496320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176220.030368:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145496320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176220.030374:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176220.030378:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176220.030380:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145496320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176220.030388:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145496448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176220.030400:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176220.030406:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87df80 x1872931145496448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176220.030414:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145496448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176220.030419:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176220.030420:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176220.030422:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145496448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176220.030426:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145496576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176220.030436:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176220.030442:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87c380 x1872931145496576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176220.030448:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145496576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176220.030458:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176220.030460:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176220.030461:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145496576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176220.030473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145496704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176220.030484:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176220.030490:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176220/real 1786176220]  req@ffff89d99e87d500 x1872931145496704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176220.030497:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145496704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176220.030502:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176220.030504:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176220.030506:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145496704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176220.541007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176220.541143:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176221.052951:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176221.565003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176221.565227:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176222.077027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176222.588953:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176222.589067:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176223.101008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176223.613093:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176223.613186:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176224.125038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176224.637046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176224.637247:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176225.148997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176225.149016:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149021:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176225.149025:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176225.149040:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00080000:1.0:1786176225.149049:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149056:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176225.149087:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145496832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176225.149112:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149116:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176225.149118:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176225.149121:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00080000:1.0:1786176225.149127:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149130:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176225.149137:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176225.149154:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145496960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176225.149154:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145496832:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176225.149169:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149172:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176225.149173:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176225.149176:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00080000:1.0:1786176225.149178:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149182:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176225.149185:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176225.149194:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145497088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176225.149200:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149203:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176225.149205:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176225.149207:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00080000:1.0:1786176225.149211:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149214:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176225.149219:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176225.149228:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145497216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176225.149238:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176225.149240:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149244:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176225.149246:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176225.149252:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00080000:1.0:1786176225.149254:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149257:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176225.149260:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176225.149270:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145497344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176225.149277:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149280:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176225.149281:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176225.149286:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00100000:3.0:1786176225.149287:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2fe680 x1872931145496832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176225.149288:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149294:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176225.149297:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176225.149306:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145497472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176225.149313:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149316:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176225.149318:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176225.149321:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00080000:1.0:1786176225.149323:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149325:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176225.149327:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176225.149334:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145497600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176225.149340:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149341:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176225.149342:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176225.149346:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00080000:1.0:1786176225.149348:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149351:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176225.149357:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176225.149366:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145497728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176225.149375:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176225.149377:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176225.149379:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176225.149383:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145496832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176225.149384:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9959
00000100:00080000:1.0:1786176225.149389:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176225.149393:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176225.149399:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176225.149411:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176225.149413:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145497856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176225.149420:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.149529:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145496832:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176225.149595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145496960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176225.149627:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176225.149642:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2fe300 x1872931145496960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176225.149656:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145496960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176225.149664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176225.149667:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.149669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145496960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176225.149673:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145497088:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176225.149689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176225.149696:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2fdc00 x1872931145497088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176225.149704:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145497088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176225.149709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176225.149711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.149713:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145497088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176225.149716:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145497216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176225.149726:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176225.149733:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2ff480 x1872931145497216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176225.149741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145497216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176225.149745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176225.149747:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.149749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145497216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176225.149753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145497344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176225.149762:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176225.149768:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2fd880 x1872931145497344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176225.149776:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145497344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176225.149780:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176225.149782:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.149784:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145497344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176225.149787:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145497472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176225.149796:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176225.149802:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2fce00 x1872931145497472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176225.149808:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145497472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176225.149814:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176225.149816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.149818:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145497472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176225.149821:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145497600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176225.149830:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176225.149836:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2fc700 x1872931145497600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176225.149842:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145497600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176225.149847:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176225.149849:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.149851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145497600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176225.149854:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145497728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176225.149863:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176225.149869:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2fdf80 x1872931145497728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176225.149875:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145497728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176225.149880:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176225.149882:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.149884:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145497728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176225.149887:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145497856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176225.149923:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176225.149938:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176225/real 1786176225]  req@ffff89d9ba2fd180 x1872931145497856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176225.149994:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145497856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176225.150001:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176225.150002:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176225.150005:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145497856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176225.661001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176225.661105:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176226.173042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176226.685045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176226.685171:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176227.197031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176227.709061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176227.709188:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176228.221016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176228.733024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176228.733099:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176229.244983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176229.757067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176229.757092:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786176230.269089:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176230.269093:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176230.269105:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176230.269110:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176230.269124:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9964
00000100:00080000:1.0:1786176230.269136:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176230.269145:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176230.269188:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145497984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176230.269215:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176230.269219:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176230.269221:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176230.269225:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9964
00000100:00080000:1.0:1786176230.269238:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176230.269242:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176230.269252:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176230.269266:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145498112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176230.269272:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145497984:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176230.269286:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176230.269290:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176230.269292:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176230.269299:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9964
00000100:00080000:1.0:1786176230.269303:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176230.269306:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176230.269311:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176230.269336:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145498240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176230.269347:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176230.269350:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176230.269355:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786176230.269356:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176230.269363:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9964
00000100:00080000:1.0:1786176230.269370:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176230.269375:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176230.269382:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176230.269395:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145498368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176230.269405:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176230.269412:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2fed80 x1872931145497984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176230.269413:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176230.269419:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176230.269431:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9964
00000100:00080000:1.0:1786176230.269439:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176230.269449:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176230.269457:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176230.269466:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145497984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176230.269474:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145498496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176230.269489:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176230.269494:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176230.269499:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176230.269501:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176230.269506:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176230.269511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145497984:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176230.269516:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9964
00000100:00080000:1.0:1786176230.269522:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176230.269534:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176230.269538:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176230.269548:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145498624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176230.269557:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145498112:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176230.269581:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176230.269586:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176230.269588:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176230.269594:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9964
00000800:00000100:3.0:1786176230.269599:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176230.269603:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176230.269611:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176230.269617:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176230.269621:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2ffb80 x1872931145498112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176230.269634:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145498752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176230.269641:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145498112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176230.269657:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176230.269667:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176230.269669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176230.269670:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176230.269682:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176230.269684:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9964
00000100:00080000:1.0:1786176230.269691:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176230.269692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145498112:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176230.269699:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176230.269708:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176230.269708:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145498240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176230.269731:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145498880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176230.269743:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176230.269744:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176230.269751:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176230.269754:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176230.269761:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9964
00000100:00100000:3.0:1786176230.269761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2ff100 x1872931145498240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176230.269765:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176230.269775:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176230.269791:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145498240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176230.269794:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176230.269813:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145499008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176230.269819:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176230.269831:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176230.269839:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145498240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176230.269847:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145498368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176230.269875:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176230.269884:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2ff800 x1872931145498368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176230.269957:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145498368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176230.269966:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176230.269969:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176230.269972:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145498368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176230.269979:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145498496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176230.270000:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176230.270011:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2fc380 x1872931145498496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176230.270022:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145498496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176230.270030:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176230.270033:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176230.270036:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145498496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176230.270056:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145498624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176230.270073:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176230.270082:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2fd500 x1872931145498624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176230.270092:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145498624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176230.270100:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176230.270102:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176230.270105:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145498624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176230.270110:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145498752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176230.270124:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176230.270133:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2fea00 x1872931145498752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176230.270143:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145498752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176230.270150:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176230.270152:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176230.270155:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145498752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176230.270160:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145498880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176230.270173:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176230.270182:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2fed80 x1872931145498880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176230.270193:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145498880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176230.270200:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176230.270203:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176230.270205:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145498880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176230.270211:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145499008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176230.270224:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176230.270242:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176230/real 1786176230]  req@ffff89d9ba2fd180 x1872931145499008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176230.270252:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145499008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176230.270260:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176230.270262:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176230.270265:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145499008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176230.781113:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176230.781178:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176231.293051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176231.805064:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176231.805171:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176232.317022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176232.829053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176232.829156:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176233.340983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176233.853047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176233.853194:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176234.365023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176234.877073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176234.877279:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786176235.389005:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176235.389008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176235.389019:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176235.389025:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176235.389035:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389044:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176235.389052:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176235.389088:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145499136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176235.389119:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176235.389122:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176235.389124:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176235.389127:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389130:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176235.389133:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176235.389141:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176235.389151:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145499264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176235.389159:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176235.389162:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145499136:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176235.389163:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176235.389167:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176235.389172:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389174:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176235.389177:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176235.389180:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176235.389194:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145499392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176235.389204:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176235.389209:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176235.389211:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176235.389216:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389222:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786176235.389223:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176235.389232:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176235.389240:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176235.389255:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145499520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176235.389264:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176235.389264:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2fdf80 x1872931145499136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176235.389272:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176235.389276:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176235.389285:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389289:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176235.389292:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176235.389296:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176235.389298:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145499136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176235.389306:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145499648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176235.389319:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176235.389320:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176235.389327:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176235.389329:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176235.389331:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176235.389335:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389338:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176235.389341:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145499136:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176235.389345:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176235.389350:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176235.389358:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145499776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176235.389370:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145499264:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176235.389373:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176235.389377:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176235.389379:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176235.389383:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389386:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176235.389389:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176235.389403:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176235.389404:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176235.389417:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145499904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176235.389422:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2fc700 x1872931145499264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176235.389432:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176235.389441:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176235.389443:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176235.389447:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145499264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176235.389450:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389457:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176235.389461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176235.389462:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176235.389471:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176235.389471:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176235.389478:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145499264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176235.389484:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145500032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176235.389486:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145499392:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176235.389504:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786176235.389510:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176235.389512:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176235.389517:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176235.389522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2fce00 x1872931145499392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176235.389526:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9969
00000100:00080000:1.0:1786176235.389537:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176235.389541:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145499392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176235.389547:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176235.389558:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176235.389558:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176235.389576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176235.389579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145499392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176235.389584:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145500160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176235.389587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145499520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176235.389610:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176235.389620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2fd880 x1872931145499520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176235.389629:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145499520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176235.389636:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176235.389638:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176235.389641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145499520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176235.389645:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145499648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176235.389655:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176235.389661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2ff480 x1872931145499648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176235.389668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145499648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176235.389674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176235.389677:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176235.389679:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145499648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176235.389690:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145499776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176235.389700:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176235.389707:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2fdc00 x1872931145499776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176235.389714:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145499776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176235.389720:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176235.389722:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176235.389724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145499776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176235.389728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145499904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176235.389738:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176235.389744:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2fe300 x1872931145499904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176235.389752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145499904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176235.389757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176235.389759:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176235.389762:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145499904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176235.389765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145500032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176235.389776:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176235.389782:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2fe680 x1872931145500032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176235.389789:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145500032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176235.389795:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176235.389796:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176235.389798:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145500032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176235.389802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145500160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176235.389811:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176235.389817:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176235/real 1786176235]  req@ffff89d9ba2fdf80 x1872931145500160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176235.389825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145500160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176235.389830:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176235.389832:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176235.389834:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145500160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176235.901047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176235.901259:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176236.413021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176236.925024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176236.925117:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176237.437059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176237.949008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176237.949097:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176238.461000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176238.973005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176238.973171:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176239.485019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176239.996989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176239.997150:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786176240.509012:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509022:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176240.509028:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176240.509043:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9974
00000100:00100000:3.0:1786176240.509052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176240.509056:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176240.509069:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176240.509119:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145500288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176240.509148:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509152:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176240.509153:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176240.509156:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9974
00000100:00080000:1.0:1786176240.509159:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176240.509161:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176240.509171:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176240.509182:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145500416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176240.509189:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509195:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176240.509196:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176240.509200:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9974
00000100:00080000:1.0:1786176240.509204:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176240.509209:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145500288:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176240.509210:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176240.509216:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176240.509235:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145500544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176240.509244:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509247:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176240.509249:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176240.509252:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9974
00000100:00080000:1.0:1786176240.509255:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176240.509258:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176240.509262:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176240.509271:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145500672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176240.509277:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509281:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176240.509283:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176240.509288:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9974
00000100:00080000:1.0:1786176240.509301:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786176240.509312:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176240.509313:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176240.509325:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176240.509342:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145500800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176240.509352:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509355:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176240.509357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176240.509364:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9974
00000100:00080000:1.0:1786176240.509369:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176240.509375:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176240.509377:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2fd180 x1872931145500288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176240.509380:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176240.509397:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145500928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176240.509425:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509429:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176240.509430:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176240.509439:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9974
00000100:00080000:1.0:1786176240.509443:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176240.509443:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145500288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176240.509452:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176240.509459:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176240.509481:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145501056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176240.509488:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176240.509490:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509501:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176240.509504:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176240.509508:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176240.509513:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9974
00000100:00080000:1.0:1786176240.509522:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176240.509527:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145500288:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176240.509531:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176240.509546:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176240.509555:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145500416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176240.509567:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145501184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176240.509581:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176240.509585:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176240.509588:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176240.509594:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9974
00000800:00000100:3.0:1786176240.509601:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176240.509604:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176240.509613:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176240.509618:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176240.509628:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2fed80 x1872931145500416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176240.509638:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145501312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176240.509669:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145500416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176240.509683:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176240.509689:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176240.509695:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145500416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176240.509730:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145500544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176240.509762:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176240.509779:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2fea00 x1872931145500544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176240.509815:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145500544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176240.509827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176240.509831:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176240.509836:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145500544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176240.509844:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145500672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176240.509873:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176240.509889:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2fd500 x1872931145500672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176240.509938:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145500672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176240.509950:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176240.509954:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176240.509959:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145500672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176240.509968:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145500800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176240.509996:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176240.510014:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2fc380 x1872931145500800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176240.510031:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145500800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176240.510041:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176240.510045:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176240.510049:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145500800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176240.510057:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145500928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176240.510082:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176240.510097:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2ff800 x1872931145500928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176240.510113:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145500928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176240.510123:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176240.510128:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176240.510131:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145500928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176240.510140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145501056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176240.510167:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176240.510183:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2ff100 x1872931145501056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176240.510200:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145501056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176240.510212:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176240.510217:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176240.510221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145501056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176240.510229:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145501184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176240.510257:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176240.510271:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2ffb80 x1872931145501184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176240.510287:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145501184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176240.510298:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176240.510302:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176240.510307:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145501184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176240.510315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145501312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176240.510341:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176240.510356:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176240/real 1786176240]  req@ffff89d9ba2fdf80 x1872931145501312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176240.510372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145501312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176240.510382:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176240.510387:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176240.510392:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145501312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176241.020966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176241.021115:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176241.532970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176242.045020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176242.045159:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176242.556976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176243.068997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176243.069113:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176243.581050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176244.093091:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176244.093241:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176244.605004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176245.116978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176245.117278:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176245.629068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176245.629119:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176245.629145:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176245.629153:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.629170:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.629187:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176245.629199:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176245.629262:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145501440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176245.629309:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176245.629315:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176245.629317:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.629323:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.629328:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176245.629333:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176245.629348:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176245.629366:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145501568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176245.629386:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145501440:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176245.629388:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176245.629403:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176245.629407:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.629414:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.629417:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176245.629425:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176245.629432:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176245.629461:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145501696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176245.629473:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176245.629479:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176245.629481:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.629488:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.629493:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176245.629497:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176245.629506:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176245.629520:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145501824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176245.629540:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786176245.629552:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176245.629557:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176245.629564:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.629575:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.629585:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176245.629595:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176245.629607:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176245.629637:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145501952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176245.629663:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176245.629666:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87f800 x1872931145501440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176245.629669:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176245.629675:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.629690:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.629702:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176245.629715:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176245.629725:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176245.629738:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145501440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176245.629772:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145502080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176245.629789:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176245.629793:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176245.629796:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.629808:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.629822:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176245.629836:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176245.629844:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176245.629846:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176245.629867:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176245.629874:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145502208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176245.629891:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145501440:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176245.629982:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176245.629984:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145501568:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176245.630012:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176245.630023:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.630038:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.630047:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176245.630055:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176245.630064:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176245.630084:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176245.630092:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145502336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176245.630118:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176245.630124:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176245.630127:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176245.630137:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9979
00000100:00080000:2.0:1786176245.630149:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176245.630149:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87d880 x1872931145501568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176245.630161:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176245.630178:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176245.630202:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145502464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176245.630215:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145501568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176245.630245:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176245.630254:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176245.630264:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145501568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176245.630279:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145501696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176245.630320:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176245.630340:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87c700 x1872931145501696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176245.630362:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145501696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176245.630393:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176245.630400:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176245.630406:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145501696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176245.630419:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145501824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176245.630455:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176245.630480:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87c000 x1872931145501824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176245.630503:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145501824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176245.630519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176245.630526:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176245.630534:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145501824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176245.630547:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145501952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176245.630586:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176245.630610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87d500 x1872931145501952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176245.630635:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145501952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176245.630669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176245.630674:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176245.630680:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145501952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176245.630691:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145502080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176245.630725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176245.630744:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87c380 x1872931145502080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176245.630789:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145502080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176245.630803:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176245.630808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176245.630813:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145502080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176245.630843:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145502208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176245.630869:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176245.630882:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87df80 x1872931145502208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176245.630893:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145502208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176245.630930:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176245.630933:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176245.630936:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145502208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176245.630943:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145502336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176245.630962:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176245.630973:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87e680 x1872931145502336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176245.630984:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145502336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176245.631010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176245.631014:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176245.631018:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145502336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176245.631025:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145502464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176245.631046:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176245.631057:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176245/real 1786176245]  req@ffff89d99e87dc00 x1872931145502464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176245.631069:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145502464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176245.631096:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176245.631100:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176245.631103:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145502464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176246.141011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176246.141285:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176246.653018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176247.165012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176247.165182:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176247.677021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176248.189021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176248.189134:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176248.700982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176249.212949:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176249.213017:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176249.725075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176250.237036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176250.237114:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176250.749012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176250.749056:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176250.749067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176250.749072:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749083:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9984
00000100:00080000:0.0:1786176250.749096:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176250.749104:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176250.749153:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145502592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176250.749186:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176250.749190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176250.749192:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749195:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9984
00000100:00080000:0.0:1786176250.749198:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176250.749202:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176250.749213:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176250.749234:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145502720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176250.749242:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145502592:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176250.749265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176250.749269:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176250.749271:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749276:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9984
00000100:00080000:0.0:1786176250.749280:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176250.749284:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176250.749288:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176250.749303:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145502848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176250.749313:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176250.749316:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176250.749318:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749320:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9984
00000100:00080000:0.0:1786176250.749330:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176250.749333:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176250.749347:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176250.749357:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145502976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176250.749371:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786176250.749371:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176250.749381:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176250.749384:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749388:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9984
00000100:00080000:0.0:1786176250.749391:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176250.749395:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176250.749400:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176250.749409:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145503104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176250.749417:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176250.749420:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176250.749421:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749424:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9984
00000100:00080000:0.0:1786176250.749427:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176250.749431:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176250.749436:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f3b80 x1872931145502592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176250.749439:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176250.749461:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145503232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176250.749467:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145502592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176250.749496:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176250.749510:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176250.749517:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749526:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9984
00000100:00080000:3.0:1786176250.749526:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176250.749535:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176250.749541:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176250.749547:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176250.749553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145502592:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176250.749557:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176250.749570:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145503360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176250.749580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176250.749581:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145502720:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176250.749594:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176250.749598:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749606:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9984
00000800:00000100:3.0:1786176250.749612:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176250.749622:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176250.749624:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f0a80 x1872931145502720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176250.749638:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176250.749642:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145502720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176250.749652:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176250.749653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176250.749662:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176250.749666:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145502720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176250.749675:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145503488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176250.749679:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145502848:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176250.749720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176250.749723:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176250.749726:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176250.749731:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9984
00000100:00080000:0.0:1786176250.749735:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176250.749740:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786176250.749747:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176250.749752:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176250.749760:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f1180 x1872931145502848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176250.749770:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145503616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176250.749777:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145502848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176250.749796:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176250.749800:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176250.749804:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145502848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176250.749810:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145502976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176250.749824:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176250.749831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f3100 x1872931145502976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176250.749839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145502976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176250.749848:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176250.749851:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176250.749853:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145502976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176250.749856:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145503104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176250.749866:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176250.749872:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f3480 x1872931145503104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176250.749879:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145503104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176250.749884:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176250.749886:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176250.749888:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145503104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176250.749892:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145503232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176250.749925:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176250.749933:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f1880 x1872931145503232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176250.749940:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145503232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176250.749945:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176250.749947:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176250.749950:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145503232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176250.749964:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145503360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176250.749975:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176250.749982:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f0e00 x1872931145503360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176250.749989:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145503360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176250.749994:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176250.749995:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176250.749997:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145503360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176250.750001:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145503488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176250.750011:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176250.750017:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f1500 x1872931145503488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176250.750024:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145503488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176250.750030:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176250.750032:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176250.750033:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145503488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176250.750037:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145503616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176250.750047:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176250.750053:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176250/real 1786176250]  req@ffff89d9870f2d80 x1872931145503616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176250.750060:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145503616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176250.750065:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176250.750067:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176250.750069:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145503616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176251.261022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176251.261097:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176251.773062:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176252.285005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176252.285119:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176252.797005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176253.308976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176253.309062:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176253.821026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176254.332995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176254.333059:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176254.845036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176255.356968:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176255.357056:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176255.869048:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869057:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176255.869062:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176255.869063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176255.869073:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00080000:2.0:1786176255.869082:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176255.869106:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176255.869141:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145503744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176255.869168:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869171:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176255.869172:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176255.869175:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00080000:2.0:1786176255.869179:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176255.869182:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176255.869190:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176255.869195:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145503744:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176255.869202:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145503872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176255.869210:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869212:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176255.869214:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176255.869217:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00080000:2.0:1786176255.869219:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176255.869221:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176255.869225:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176255.869234:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145504000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176255.869242:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869245:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176255.869247:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176255.869251:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00080000:2.0:1786176255.869257:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176255.869262:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176255.869267:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176255.869282:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145504128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176255.869291:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145503872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176255.869299:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869305:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176255.869308:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176255.869315:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00100000:3.0:1786176255.869320:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145504000:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176255.869321:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176255.869331:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176255.869337:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176255.869352:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145504128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176255.869353:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145504256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176255.869365:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869368:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176255.869370:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176255.869375:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00080000:2.0:1786176255.869379:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176255.869381:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145504256:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176255.869386:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176255.869409:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176255.869422:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145504384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176255.869439:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869441:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176255.869443:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176255.869447:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00080000:2.0:1786176255.869452:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176255.869455:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176255.869459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145504384:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176255.869461:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176255.869476:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145504512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176255.869486:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869489:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176255.869490:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176255.869494:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145504512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176255.869497:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00080000:2.0:1786176255.869503:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176255.869506:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176255.869510:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176255.869521:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145504640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176255.869533:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176255.869537:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176255.869540:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176255.869545:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9990
00000100:00080000:2.0:1786176255.869550:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176255.869556:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145504640:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176255.869559:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176255.869570:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176255.869589:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145504768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176255.869627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145504768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176256.380981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176256.381097:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176256.893021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176257.405001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176257.405048:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176257.917007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176258.429085:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176258.429260:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176258.941038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:3.0:1786176258.941328:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:3.0:1786176258.941371:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1786176258.941408:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786176258.941481:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:3.0:1786176258.941503:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176258.941511:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87f100 x1872931145503744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786176258.941522:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786176258.941541:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786176258.941561:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176258.941567:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145503744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786176258.941582:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176258.941599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000800:00000100:3.0:1786176258.941607:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176258.941615:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.941647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145503744:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176258.941682:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87c000 x1872931145504768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1786176258.941683:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176258.941714:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145504768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176258.941730:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176258.941736:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.941741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145504768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176258.941752:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87d500 x1872931145504640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176258.941771:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145504640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176258.941784:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176258.941789:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.941794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145504640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176258.941804:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87c380 x1872931145504512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176258.941820:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145504512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176258.941832:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176258.941855:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.941860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145504512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176258.941871:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87df80 x1872931145504384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176258.941890:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145504384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176258.941962:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176258.941967:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.941972:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145504384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176258.941981:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87e680 x1872931145504256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176258.941999:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145504256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176258.942010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176258.942015:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.942020:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145504256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176258.942029:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87dc00 x1872931145504128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176258.942046:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145504128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176258.942058:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176258.942063:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.942069:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145504128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176258.942078:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87ca80 x1872931145503872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176258.942095:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145503872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176258.942108:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176258.942113:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.942118:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145503872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176258.942127:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176255/real 1786176258]  req@ffff89d99e87ed80 x1872931145504000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176258.942145:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145504000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176258.942158:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176258.942163:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176258.942168:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145504000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176259.452989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176259.453059:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176259.964949:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176260.477030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176260.477091:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176260.989047:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989057:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176260.989063:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989073:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00100000:3.0:1786176260.989083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176260.989084:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989097:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176260.989134:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145504896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176260.989157:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989161:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176260.989163:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989172:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00080000:0.0:1786176260.989175:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989178:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176260.989198:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176260.989207:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145505024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176260.989218:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989220:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176260.989223:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989234:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00100000:3.0:1786176260.989237:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145504896:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176260.989239:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989253:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176260.989265:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176260.989274:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145505152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176260.989282:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989284:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176260.989286:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989289:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00080000:0.0:1786176260.989291:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989294:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176260.989298:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176260.989307:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145505280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176260.989314:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989319:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176260.989320:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989323:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00080000:0.0:1786176260.989326:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989329:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176260.989331:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176260.989346:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145505408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176260.989355:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989360:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176260.989363:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989369:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00080000:0.0:1786176260.989375:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989382:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176260.989389:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176260.989409:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176260.989411:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145505536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176260.989427:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989431:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176260.989434:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989441:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00080000:0.0:1786176260.989458:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989465:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176260.989474:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176260.989504:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145505664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176260.989512:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f0700 x1872931145504896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176260.989523:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989541:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176260.989549:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989563:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00080000:0.0:1786176260.989580:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989595:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176260.989638:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145504896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176260.989643:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176260.989678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176260.989679:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145505792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176260.989698:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.989718:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145504896:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176260.989730:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176260.989737:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176260.989740:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176260.989746:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 9995
00000100:00080000:0.0:1786176260.989754:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176260.989758:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176260.989763:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176260.989777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145505024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176260.989784:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145505920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176260.989840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176260.989869:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f2680 x1872931145505024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176260.989893:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145505024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176260.989956:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176260.989963:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.989969:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145505024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176260.991306:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145505152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176260.991435:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176260.991463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f2a00 x1872931145505152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176260.991480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145505152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176260.991499:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176260.991503:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.991507:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145505152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176260.991517:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145505280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176260.991541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176260.991569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f2d80 x1872931145505280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176260.991583:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145505280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176260.991591:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176260.991595:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.991622:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145505280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176260.991635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145505408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176260.991672:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176260.991701:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f1500 x1872931145505408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176260.991724:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145505408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176260.991738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176260.991744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.991751:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145505408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176260.991765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145505536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176260.991799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176260.991813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f0e00 x1872931145505536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176260.991829:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145505536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176260.991840:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176260.991847:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.991853:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145505536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176260.991864:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145505664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176260.991942:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176260.991960:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f1880 x1872931145505664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176260.991975:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145505664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176260.991984:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176260.991987:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.991991:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145505664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176260.991998:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145505792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176260.992023:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176260.992035:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f3480 x1872931145505792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176260.992047:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145505792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176260.992056:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176260.992059:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.992062:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145505792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176260.992108:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145505920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176260.992144:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176260.992164:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176260/real 1786176260]  req@ffff89d9870f3100 x1872931145505920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176260.992182:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145505920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176285 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176260.992194:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176260.992199:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176260.992203:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145505920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176261.501094:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176261.501174:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176262.012978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176262.525000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176262.525085:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176263.037009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176263.549109:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176263.549196:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176264.060993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176264.573053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176264.573176:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176265.085061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176265.597051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176265.597176:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176266.109023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176266.109136:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176266.109147:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176266.109153:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176266.109166:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:0.0:1786176266.109180:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176266.109189:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176266.109245:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145506048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176266.109292:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176266.109299:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176266.109302:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176266.109309:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:0.0:1786176266.109317:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176266.109334:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176266.109351:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176266.109374:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145506048:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176266.109384:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145506176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176266.109409:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176266.109415:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176266.109418:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176266.109426:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:0.0:1786176266.109433:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176266.109440:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176266.109448:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176266.109481:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145506304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176266.109498:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176266.109499:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176266.109510:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176266.109515:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176266.109536:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:0.0:1786176266.109546:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176266.109578:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176266.109590:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176266.109632:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f1180 x1872931145506048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176266.109634:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145506432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176266.109718:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176266.109726:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1786176266.109727:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145506048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176266.109737:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176266.109758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176266.109762:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:3.0:1786176266.109768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176266.109781:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176266.109781:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145506048:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176266.109799:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176266.109811:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176266.109826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145506176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176266.109836:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145506560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176266.109857:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1786176266.109866:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176266.109873:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176266.109878:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176266.109891:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f0a80 x1872931145506176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176266.109892:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:0.0:1786176266.109937:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176266.109946:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176266.109961:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176266.109986:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145506176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176266.109994:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145506688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176266.110022:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176266.110030:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176266.110036:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176266.110037:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145506176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176266.110058:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:3.0:1786176266.110062:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145506304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176266.110066:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176266.110077:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:0.0:1786176266.110088:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176266.110094:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786176266.110101:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176266.110104:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176266.110118:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f3b80 x1872931145506304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176266.110132:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145506816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176266.110135:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145506304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176266.110207:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176266.110220:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176266.110221:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176266.110234:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145506304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176266.110237:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176266.110243:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176266.110250:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145506432:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176266.110257:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:0.0:1786176266.110270:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176266.110277:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176266.110285:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176266.110299:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176266.110309:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145506944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176266.110326:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f3100 x1872931145506432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176266.110330:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176266.110353:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176266.110358:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176266.110362:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145506432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176266.110374:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10000
00000100:00080000:3.0:1786176266.110382:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176266.110390:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176266.110390:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176266.110400:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145506432:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176266.110408:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176266.110420:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176266.110430:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145506560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176266.110445:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145507072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176266.110479:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176266.110494:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f3480 x1872931145506560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176266.110515:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145506560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176266.110531:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176266.110535:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176266.110538:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145506560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176266.110546:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145506688:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176266.110590:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176266.110612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f1880 x1872931145506688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176266.110623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145506688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176266.110631:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176266.110634:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176266.110637:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145506688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176266.110643:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145506816:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176266.110658:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176266.110666:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f0e00 x1872931145506816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176266.110679:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145506816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176266.110687:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176266.110690:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176266.110695:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145506816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176266.110702:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145506944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176266.110717:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176266.110725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f1500 x1872931145506944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176266.110740:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145506944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176266.110749:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176266.110753:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176266.110756:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145506944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176266.110774:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145507072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176266.110790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176266.110799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176266/real 1786176266]  req@ffff89d9870f2d80 x1872931145507072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176266.110810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145507072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176266.110827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176266.110830:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176266.110833:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145507072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176266.620977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176266.621063:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176267.133025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176267.645085:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176267.645197:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176268.157011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176268.668997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176268.669097:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176269.181016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176269.693110:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176269.693236:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176270.205025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176270.716997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176270.717082:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176271.229004:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229013:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1786176271.229013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176271.229018:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176271.229028:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229036:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176271.229043:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176271.229076:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145507200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176271.229095:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229098:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176271.229099:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176271.229102:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229104:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176271.229107:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176271.229114:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176271.229123:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145507328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176271.229131:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229133:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176271.229135:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176271.229138:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145507200:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176271.229141:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229146:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176271.229150:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176271.229153:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176271.229161:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145507456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176271.229167:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229169:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176271.229171:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176271.229173:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229175:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176271.229177:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176271.229180:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176271.229188:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145507584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176271.229194:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229197:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176271.229198:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176271.229200:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229203:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176271.229205:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176271.229208:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176271.229211:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176271.229217:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145507712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176271.229224:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229227:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176271.229228:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176271.229232:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229234:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176271.229236:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176271.229239:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176271.229253:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145507840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176271.229259:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229262:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176271.229263:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176271.229268:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229271:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176271.229271:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f2a00 x1872931145507200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176271.229276:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176271.229282:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176271.229296:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145507968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176271.229304:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145507200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176271.229312:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229321:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176271.229325:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176271.229330:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229334:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176271.229337:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176271.229340:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176271.229346:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786176271.229348:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176271.229354:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145507200:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176271.229365:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145508096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176271.229375:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176271.229379:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176271.229383:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176271.229383:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145507328:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176271.229394:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10005
00000100:00080000:0.0:1786176271.229400:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176271.229404:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176271.229409:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176271.229420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176271.229432:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145508224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176271.229439:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f2680 x1872931145507328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176271.229459:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145507328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176271.229469:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176271.229473:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176271.229477:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145507328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176271.229484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145507456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176271.229539:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176271.229554:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f0700 x1872931145507456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176271.229569:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145507456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176271.229578:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176271.229582:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176271.229585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145507456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176271.229593:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145507584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176271.229615:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176271.229628:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f2d80 x1872931145507584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176271.229651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145507584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176271.229661:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176271.229665:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176271.229669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145507584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176271.229675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145507712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176271.229714:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176271.229726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f1500 x1872931145507712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176271.229738:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145507712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176271.229746:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176271.229749:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176271.229752:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145507712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176271.229759:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145507840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176271.229780:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176271.229792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f0e00 x1872931145507840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176271.229804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145507840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176271.229812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176271.229816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176271.229819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145507840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176271.229825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145507968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176271.229846:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176271.229857:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f1880 x1872931145507968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176271.229876:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145507968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176271.229885:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176271.229888:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176271.229892:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145507968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176271.229899:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145508096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176271.229940:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176271.229953:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f3480 x1872931145508096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176271.229966:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145508096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176271.229975:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176271.229978:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176271.229982:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145508096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176271.230005:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145508224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176271.230026:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176271.230038:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176271/real 1786176271]  req@ffff89d9870f3100 x1872931145508224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176271.230050:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145508224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176271.230065:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176271.230069:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176271.230072:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145508224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176271.741017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176271.741088:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176272.253043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176272.765027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176272.765128:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176273.276990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176273.789088:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176273.789102:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786176274.300978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176274.813038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176274.813077:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176275.325059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176275.837065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176275.837137:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176276.349040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176276.349050:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176276.349056:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176276.349069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176276.349069:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349086:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176276.349095:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176276.349135:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145508352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176276.349165:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176276.349170:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176276.349171:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176276.349175:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349180:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176276.349187:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176276.349197:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176276.349209:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145508480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176276.349219:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145508352:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176276.349226:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176276.349240:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176276.349243:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176276.349248:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349250:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176276.349256:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176276.349262:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176276.349287:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145508608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176276.349297:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176276.349300:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176276.349302:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176276.349307:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349311:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176276.349315:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176276.349320:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176276.349323:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176276.349338:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145508736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176276.349351:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176276.349355:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176276.349357:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176276.349363:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349366:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176276.349372:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176276.349378:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176276.349384:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe67100 x1872931145508352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176276.349390:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145508864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176276.349444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176276.349447:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176276.349466:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145508352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176276.349469:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176276.349485:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349495:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176276.349498:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176276.349504:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176276.349510:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176276.349516:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176276.349519:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145508352:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176276.349535:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145508992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176276.349545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176276.349549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176276.349552:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176276.349555:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349560:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176276.349564:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145508480:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176276.349566:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176276.349582:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176276.349596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145509120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176276.349609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176276.349610:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176276.349622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176276.349626:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176276.349632:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349637:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176276.349638:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe66a00 x1872931145508480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176276.349645:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176276.349660:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176276.349667:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145508480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176276.349677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145509248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176276.349681:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176276.349698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176276.349702:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176276.349705:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176276.349710:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176276.349718:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145508480:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176276.349719:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10010
00000100:00080000:3.0:1786176276.349729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176276.349738:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176276.349743:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176276.349747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145508608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176276.349759:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145509376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176276.349781:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176276.349794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe64a80 x1872931145508608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176276.349810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145508608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176276.349817:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176276.349820:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176276.349823:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145508608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176276.349828:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145508736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176276.349841:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176276.349847:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe65500 x1872931145508736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176276.349855:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145508736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176276.349860:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176276.349862:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176276.349864:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145508736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176276.349867:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145508864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176276.349880:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176276.349891:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe66680 x1872931145508864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176276.349931:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145508864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176276.349942:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176276.349945:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176276.349947:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145508864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176276.349952:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145508992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176276.349970:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176276.349978:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe65880 x1872931145508992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176276.349985:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145508992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176276.349991:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176276.349993:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176276.349994:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145508992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176276.350012:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145509120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176276.350029:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176276.350040:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe67480 x1872931145509120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176276.350054:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145509120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176276.350063:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176276.350067:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176276.350071:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145509120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176276.350078:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145509248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176276.350094:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176276.350102:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe67100 x1872931145509248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176276.350110:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145509248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176276.350115:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176276.350118:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176276.350121:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145509248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176276.350128:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145509376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176276.350146:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176276.350158:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176276/real 1786176276]  req@ffff89d99fe67800 x1872931145509376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176276.350172:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145509376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176276.350179:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176276.350182:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176276.350184:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145509376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176276.861024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176276.861097:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176277.373036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176277.885071:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176277.885178:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176278.397012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176278.909006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176278.909162:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176279.421069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176279.933046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176279.933145:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176280.445114:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176280.957007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176280.957153:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176281.469009:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469023:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176281.469030:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176281.469046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176281.469052:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469072:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176281.469082:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176281.469121:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145509504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176281.469152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176281.469157:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176281.469160:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469164:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176281.469167:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176281.469178:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176281.469191:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145509632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176281.469201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469207:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176281.469212:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145509504:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176281.469212:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176281.469228:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469231:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176281.469235:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176281.469241:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176281.469260:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145509760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176281.469270:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469273:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176281.469275:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176281.469278:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469281:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176281.469285:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176281.469289:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176281.469299:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145509888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176281.469307:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469310:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176281.469311:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176281.469315:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469318:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176281.469329:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176281.469337:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176281.469343:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176281.469355:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145510016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176281.469364:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469368:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176281.469370:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176281.469373:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469377:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176281.469380:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176281.469386:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176281.469424:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe66d80 x1872931145509504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176281.469434:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145510144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176281.469466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469469:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176281.469471:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176281.469475:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145509504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176281.469481:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469497:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176281.469507:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176281.469508:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.469532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176281.469533:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176281.469555:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145509504:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176281.469576:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145510272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176281.469586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469589:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176281.469592:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176281.469597:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145509632:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176281.469598:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469610:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176281.469616:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176281.469622:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176281.469635:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145510400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176281.469644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176281.469668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176281.469671:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176281.469673:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176281.469678:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe66300 x1872931145509632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176281.469679:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10015
00000100:00080000:3.0:1786176281.469690:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176281.469703:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176281.469711:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176281.469726:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145510528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176281.469734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145509632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176281.469767:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.469775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176281.469783:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145509632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176281.469793:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145509760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176281.469819:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176281.469850:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe64700 x1872931145509760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176281.469881:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145509760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176281.469926:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.469931:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176281.469935:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145509760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176281.469942:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145509888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176281.469967:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176281.469979:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe65f80 x1872931145509888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176281.469991:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145509888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176281.469999:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.470002:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176281.470005:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145509888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176281.470010:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145510016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176281.470025:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176281.470033:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe67b80 x1872931145510016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176281.470044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145510016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176281.470057:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.470060:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176281.470063:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145510016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176281.470068:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145510144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176281.470082:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176281.470090:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe65180 x1872931145510144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176281.470099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145510144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176281.470107:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.470109:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176281.470112:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145510144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176281.470116:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145510272:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176281.470130:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176281.470138:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe64380 x1872931145510272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176281.470147:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145510272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176281.470154:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.470156:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176281.470160:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145510272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176281.470186:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145510400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176281.470202:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176281.470210:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe64000 x1872931145510400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176281.470221:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145510400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176281.470229:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.470231:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176281.470233:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145510400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176281.470239:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145510528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176281.470252:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176281.470260:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176281/real 1786176281]  req@ffff89d99fe66d80 x1872931145510528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176281.470271:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145510528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176281.470278:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176281.470281:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176281.470283:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145510528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176281.981012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176281.981053:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176282.493021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176283.005034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176283.005093:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176283.517003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176284.028994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176284.029060:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176284.541017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176285.053014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176285.053165:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176285.565010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176286.076971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176286.077067:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176286.588980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176286.589023:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176286.589031:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176286.589036:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176286.589046:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:3.0:1786176286.589057:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176286.589066:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176286.589105:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145510656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176286.589136:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176286.589139:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176286.589141:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176286.589146:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:3.0:1786176286.589150:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176286.589155:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589165:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145510656:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176286.589166:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176286.589187:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145510784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176286.589200:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176286.589204:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176286.589206:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176286.589211:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:3.0:1786176286.589216:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176286.589220:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176286.589224:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176286.589226:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176286.589238:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145510912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176286.589246:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176286.589249:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176286.589250:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176286.589253:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:3.0:1786176286.589257:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176286.589260:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589264:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe67800 x1872931145510656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176286.589266:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176286.589279:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145511040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176286.589285:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145510656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176286.589316:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176286.589321:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176286.589323:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176286.589328:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176286.589331:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176286.589336:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145510656:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176286.589344:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:3.0:1786176286.589375:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176286.589383:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589387:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145510784:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176286.589396:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176286.589418:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145511168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176286.589431:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176286.589434:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176286.589436:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176286.589442:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176286.589446:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:3.0:1786176286.589453:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176286.589459:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176286.589464:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176286.589474:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe67100 x1872931145510784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176286.589477:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145511296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176286.589529:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176286.589533:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145510784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176286.589537:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176286.589543:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176286.589553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176286.589555:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:1.0:1786176286.589563:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176286.589584:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176286.589586:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145510784:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176286.589593:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589596:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145510912:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176286.589604:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176286.589619:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145511424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176286.589626:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176286.589631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176286.589632:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176286.589637:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176286.589641:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:3.0:1786176286.589645:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176286.589649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe67480 x1872931145510912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176286.589651:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176286.589659:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176286.589670:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145511552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176286.589675:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145510912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176286.589682:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176286.589689:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176286.589693:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176286.589694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176286.589698:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10020
00000100:00080000:1.0:1786176286.589702:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176286.589704:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176286.589708:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145510912:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176286.589711:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176286.589718:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176286.589721:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145511040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176286.589729:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145511680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176286.589740:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe65880 x1872931145511040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176286.589759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145511040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176286.589765:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176286.589768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176286.589770:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145511040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176286.589782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145511168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176286.589792:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589798:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe66680 x1872931145511168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176286.589805:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145511168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176286.589815:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176286.589816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176286.589818:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145511168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176286.589821:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145511296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176286.589831:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589836:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe65500 x1872931145511296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176286.589843:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145511296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176286.589866:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176286.589869:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176286.589872:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145511296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176286.589877:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145511424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176286.589893:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589901:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe64a80 x1872931145511424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176286.589959:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145511424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176286.589965:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176286.589967:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176286.589970:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145511424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176286.589974:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145511552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176286.589988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176286.589995:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe66a00 x1872931145511552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176286.590003:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145511552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176286.590008:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176286.590009:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176286.590011:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145511552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176286.590014:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145511680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176286.590024:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176286.590029:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176286/real 1786176286]  req@ffff89d99fe67800 x1872931145511680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176286.590036:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145511680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176286.590041:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176286.590043:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176286.590045:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145511680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176287.101020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176287.101094:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176287.612961:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176288.125037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176288.125051:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176288.636974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176289.149015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176289.149055:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176289.661043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176290.172977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176290.173041:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176290.684997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176291.197053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176291.197184:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176291.708966:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176291.708974:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176291.708978:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176291.708987:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00100000:2.0:1786176291.708994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176291.708996:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709005:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176291.709037:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145511808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176291.709057:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176291.709060:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176291.709061:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176291.709064:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00080000:3.0:1786176291.709066:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709069:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176291.709077:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176291.709086:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145511936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176291.709090:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145511808:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176291.709098:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176291.709101:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176291.709102:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176291.709106:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00080000:3.0:1786176291.709108:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709110:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176291.709113:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176291.709121:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145512064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176291.709128:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176291.709130:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176291.709131:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176291.709133:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00080000:3.0:1786176291.709136:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709138:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176291.709141:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176291.709151:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176291.709152:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145512192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176291.709160:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176291.709164:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176291.709166:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176291.709169:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00080000:3.0:1786176291.709172:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709174:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176291.709176:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176291.709183:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145512320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176291.709189:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176291.709191:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe66d80 x1872931145511808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176291.709192:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176291.709195:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176291.709213:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00080000:3.0:1786176291.709216:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709219:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176291.709222:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176291.709224:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145511808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176291.709232:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145512448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176291.709235:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176291.709244:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176291.709246:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176291.709250:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176291.709251:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145511808:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176291.709253:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176291.709260:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00080000:3.0:1786176291.709262:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709265:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176291.709268:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176291.709274:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145512576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176291.709279:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145511936:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176291.709286:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176291.709289:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176291.709291:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176291.709294:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00080000:3.0:1786176291.709298:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709316:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176291.709320:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176291.709322:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176291.709342:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145512704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176291.709347:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe64000 x1872931145511936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176291.709360:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176291.709364:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176291.709366:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176291.709369:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145511936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176291.709372:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10025
00000100:00080000:3.0:1786176291.709377:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176291.709383:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176291.709384:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786176291.709387:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176291.709390:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176291.709396:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145511936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176291.709399:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145512832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176291.709405:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145512064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176291.709432:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176291.709443:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe64380 x1872931145512064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176291.709463:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145512064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176291.709472:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176291.709475:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176291.709479:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145512064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176291.709484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145512192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176291.709500:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176291.709508:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe65180 x1872931145512192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176291.709516:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145512192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176291.709521:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176291.709523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176291.709525:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145512192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176291.709529:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145512320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176291.709538:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176291.709543:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe67b80 x1872931145512320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176291.709562:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145512320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176291.709571:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176291.709573:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176291.709575:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145512320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176291.709578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145512448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176291.709587:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176291.709592:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe65f80 x1872931145512448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176291.709599:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145512448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176291.709605:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176291.709606:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176291.709608:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145512448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176291.709630:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145512576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176291.709640:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176291.709645:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe64700 x1872931145512576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176291.709652:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145512576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176291.709657:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176291.709658:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176291.709661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145512576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176291.709664:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145512704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176291.709673:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176291.709689:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe66300 x1872931145512704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176291.709695:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145512704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176291.709700:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176291.709702:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176291.709704:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145512704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176291.709707:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145512832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176291.709715:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176291.709720:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176291/real 1786176291]  req@ffff89d99fe66d80 x1872931145512832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176291.709727:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145512832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176291.709732:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176291.709734:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176291.709736:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145512832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176292.220987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176292.221047:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176292.732999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176293.245023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176293.245052:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176293.757013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176294.269025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176294.269122:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176294.781018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176295.293026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176295.293092:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176295.804988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176296.317015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176296.317246:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176296.829029:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176296.829058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176296.829060:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176296.829067:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176296.829092:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10031
00000100:00080000:0.0:1786176296.829105:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176296.829115:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176296.829160:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145512960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176296.829197:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176296.829201:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176296.829203:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176296.829207:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10031
00000100:00080000:0.0:1786176296.829210:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176296.829214:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176296.829223:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176296.829270:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145513088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176296.829281:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176296.829284:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176296.829287:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176296.829292:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10031
00000100:00080000:0.0:1786176296.829296:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176296.829317:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176296.829323:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176296.829326:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145512960:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176296.829338:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145513216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176296.829349:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176296.829352:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176296.829353:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176296.829356:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10031
00000100:00080000:0.0:1786176296.829360:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176296.829363:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176296.829367:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176296.829378:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145513344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176296.829387:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176296.829390:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176296.829392:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176296.829397:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176296.829400:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10031
00000100:00080000:0.0:1786176296.829406:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176296.829410:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176296.829415:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176296.829425:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145513472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176296.829433:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176296.829436:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176296.829438:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176296.829441:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10031
00000100:00080000:0.0:1786176296.829445:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176296.829449:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176296.829453:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176296.829457:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f3b80 x1872931145512960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176296.829468:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145513600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176296.829479:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176296.829485:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176296.829486:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145512960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176296.829488:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176296.829517:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10031
00000100:00080000:0.0:1786176296.829524:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176296.829525:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176296.829531:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176296.829537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786176296.829541:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176296.829546:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145512960:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176296.829557:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145513728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176296.829562:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145513088:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176296.829580:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176296.829584:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176296.829587:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176296.829597:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10031
00000800:00000100:1.0:1786176296.829603:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176296.829608:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176296.829618:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176296.829623:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f0a80 x1872931145513088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176296.829632:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176296.829640:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145513088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176296.829658:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176296.829665:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176296.829666:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145513856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176296.829672:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145513088:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176296.829692:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176296.829697:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176296.829700:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176296.829705:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10031
00000100:00080000:0.0:1786176296.829711:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176296.829712:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145513216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176296.829722:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176296.829739:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176296.829741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176296.829757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f1180 x1872931145513216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176296.829764:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145513984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176296.829824:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145513216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176296.829833:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176296.829836:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176296.829840:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145513216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176296.829846:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145513344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176296.829866:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176296.829875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f3100 x1872931145513344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176296.829889:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145513344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176296.829897:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176296.829900:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176296.829906:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145513344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176296.829960:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145513472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176296.829985:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176296.829998:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f3480 x1872931145513472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176296.830015:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145513472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176296.830028:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176296.830031:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176296.830036:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145513472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176296.830041:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145513600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176296.830064:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176296.830084:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f1880 x1872931145513600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176296.830095:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145513600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176296.830112:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176296.830115:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176296.830117:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145513600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176296.830123:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145513728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176296.830143:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176296.830154:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f0e00 x1872931145513728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176296.830168:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145513728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176296.830175:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176296.830177:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176296.830187:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145513728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176296.830195:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145513856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176296.830223:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176296.830243:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f1500 x1872931145513856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176296.830281:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145513856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176296.830293:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176296.830296:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176296.830301:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145513856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176296.830324:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145513984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176296.830348:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176296.830368:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176296/real 1786176296]  req@ffff89d9870f2d80 x1872931145513984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176296.830383:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145513984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176296.830391:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176296.830395:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176296.830398:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145513984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176297.341025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176297.341178:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176297.853021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176298.365041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176298.365177:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176298.877094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176299.389033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176299.389290:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176299.901083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176300.413102:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176300.413321:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176300.925051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176301.437044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176301.437131:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176301.949041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176301.949045:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949054:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176301.949059:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949069:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949080:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949088:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176301.949136:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145514112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176301.949163:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949167:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176301.949168:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949171:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949174:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949177:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176301.949187:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176301.949199:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145514240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176301.949200:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145514112:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176301.949239:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949244:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176301.949248:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949252:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949255:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949258:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176301.949262:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176301.949274:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145514368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176301.949281:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949284:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176301.949286:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949288:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949290:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949292:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176301.949295:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176301.949305:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145514496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176301.949311:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949314:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176301.949316:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949319:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949321:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949323:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176301.949326:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176301.949331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176301.949338:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145514624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176301.949346:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949349:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176301.949351:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949353:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949356:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949359:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176301.949362:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176301.949368:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145514752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176301.949375:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949377:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176301.949379:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949382:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949384:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949387:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176301.949406:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176301.949413:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe67800 x1872931145514112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176301.949416:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145514880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176301.949435:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949441:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176301.949443:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949448:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949452:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949455:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949458:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145514112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176301.949459:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176301.949471:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145515008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176301.949473:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.949482:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176301.949482:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176301.949487:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176301.949489:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145514112:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176301.949490:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176301.949497:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10036
00000100:00080000:3.0:1786176301.949499:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176301.949502:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176301.949505:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176301.949512:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145515136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176301.949522:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145514240:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176301.949546:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949555:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe66a00 x1872931145514240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176301.949564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145514240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176301.949571:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.949573:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176301.949575:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145514240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176301.949580:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145514368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176301.949592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949598:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe64a80 x1872931145514368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176301.949611:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145514368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176301.949616:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.949618:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176301.949620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145514368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176301.949623:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145514496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176301.949645:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949652:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe65500 x1872931145514496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176301.949660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145514496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176301.949666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.949668:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176301.949670:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145514496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176301.949674:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145514624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176301.949684:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949696:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe66680 x1872931145514624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176301.949704:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145514624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176301.949714:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.949716:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176301.949718:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145514624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176301.949722:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145514752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176301.949737:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949747:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe65880 x1872931145514752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176301.949760:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145514752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176301.949770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.949774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176301.949778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145514752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176301.949784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145514880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176301.949799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949825:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe67480 x1872931145514880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176301.949834:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145514880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176301.949840:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.949842:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176301.949844:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145514880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176301.949849:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145515008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176301.949861:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949866:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe67100 x1872931145515008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176301.949877:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145515008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176301.949886:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.949889:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176301.949893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145515008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176301.949958:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145515136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176301.949976:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176301.949984:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176301/real 1786176301]  req@ffff89d99fe66d80 x1872931145515136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176301.949992:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145515136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176301.949998:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176301.950001:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176301.950003:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145515136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176302.461083:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176302.461243:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176302.973100:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176303.485009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176303.485106:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176303.997038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176304.509051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176304.509147:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176305.021068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176305.533003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176305.533108:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176306.045064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176306.557005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176306.557113:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176307.069058:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176307.069069:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786176307.069073:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176307.069074:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069090:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00080000:3.0:1786176307.069101:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069110:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176307.069147:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145515264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176307.069188:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176307.069192:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176307.069193:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069197:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00080000:3.0:1786176307.069200:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069203:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176307.069212:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176307.069224:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145515392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176307.069233:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176307.069235:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176307.069237:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069240:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00080000:3.0:1786176307.069242:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069247:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176307.069249:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145515264:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176307.069251:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176307.069264:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145515520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176307.069272:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176307.069274:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176307.069277:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069279:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00080000:3.0:1786176307.069282:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069284:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176307.069288:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176307.069299:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145515648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176307.069305:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176307.069308:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176307.069310:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069313:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00080000:3.0:1786176307.069315:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069317:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176307.069321:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176307.069326:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176307.069331:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145515776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176307.069339:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176307.069342:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176307.069344:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069347:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00080000:3.0:1786176307.069350:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069353:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176307.069356:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176307.069365:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145515904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176307.069373:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176307.069376:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176307.069378:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069382:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00100000:1.0:1786176307.069384:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe66300 x1872931145515264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176307.069385:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069393:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176307.069399:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176307.069413:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145516032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176307.069422:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145515264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176307.069422:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176307.069431:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176307.069434:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069443:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00080000:3.0:1786176307.069449:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069452:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176307.069453:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786176307.069456:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176307.069461:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176307.069468:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145516160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176307.069470:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145515264:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176307.069486:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176307.069488:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145515392:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176307.069491:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176307.069495:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176307.069500:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10041
00000100:00080000:3.0:1786176307.069504:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176307.069506:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176307.069510:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176307.069519:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145516288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176307.069527:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176307.069545:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe64700 x1872931145515392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176307.069561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145515392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176307.069570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176307.069574:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176307.069577:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145515392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176307.069621:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145515520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176307.069644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176307.069656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe65f80 x1872931145515520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176307.069678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145515520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176307.069687:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176307.069691:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176307.069695:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145515520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176307.069701:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145515648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176307.069722:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176307.069734:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe67b80 x1872931145515648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176307.069748:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145515648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176307.069756:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176307.069760:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176307.069764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145515648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176307.069771:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145515776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176307.069789:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176307.069800:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe65180 x1872931145515776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176307.069813:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145515776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176307.069843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176307.069847:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176307.069850:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145515776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176307.069856:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145515904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176307.069874:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176307.069885:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe64380 x1872931145515904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176307.069897:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145515904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176307.069906:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176307.069909:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176307.069913:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145515904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176307.069919:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145516032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176307.069965:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176307.069980:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe64000 x1872931145516032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176307.069994:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145516032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176307.070003:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176307.070007:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176307.070011:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145516032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176307.070019:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145516160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176307.070041:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176307.070052:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe66d80 x1872931145516160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176307.070061:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145516160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176307.070067:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176307.070069:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176307.070072:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145516160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176307.070076:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145516288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176307.070088:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176307.070095:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176307/real 1786176307]  req@ffff89d99fe67100 x1872931145516288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176307.070103:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145516288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176307.070109:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176307.070111:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176307.070113:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145516288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176307.581042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176307.581093:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176308.093053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176308.605029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176308.605130:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176309.117045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176309.628974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176309.629232:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176310.141088:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176310.652984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176310.653111:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176311.165217:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176311.677035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176311.677185:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176312.188988:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176312.188998:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176312.189003:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189014:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00080000:3.0:1786176312.189025:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189032:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176312.189053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176312.189075:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145516416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176312.189097:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176312.189100:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176312.189121:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189125:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00080000:3.0:1786176312.189128:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189131:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176312.189140:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176312.189148:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145516544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176312.189156:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176312.189159:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176312.189160:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189164:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00080000:3.0:1786176312.189166:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189169:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176312.189172:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176312.189186:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145516416:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176312.189201:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145516672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176312.189212:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176312.189216:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176312.189218:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189223:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00080000:3.0:1786176312.189225:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189230:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176312.189236:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176312.189250:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145516800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176312.189257:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176312.189261:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176312.189262:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189266:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00080000:3.0:1786176312.189270:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189276:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176312.189283:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176312.189286:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176312.189297:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145516928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176312.189304:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176312.189307:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176312.189309:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189312:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00080000:3.0:1786176312.189314:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189317:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176312.189320:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176312.189329:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145517056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176312.189335:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176312.189339:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176312.189341:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe67480 x1872931145516416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176312.189343:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189358:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00080000:3.0:1786176312.189366:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189370:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176312.189374:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145516416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176312.189375:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176312.189395:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145517184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176312.189397:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189414:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176312.189420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176312.189426:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145516416:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176312.189427:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176312.189436:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189449:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00100000:1.0:1786176312.189451:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145516544:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176312.189454:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189461:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176312.189468:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176312.189477:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176312.189482:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145517312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176312.189493:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe65880 x1872931145516544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176312.189495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176312.189510:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176312.189517:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176312.189530:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10046
00000100:00100000:1.0:1786176312.189533:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145516544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176312.189535:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176312.189541:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176312.189548:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176312.189561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145517440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176312.189565:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176312.189582:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145516544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176312.189618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145516672:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176312.189637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176312.189646:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe66680 x1872931145516672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176312.189660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145516672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176312.189666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189668:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176312.189670:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145516672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176312.189675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145516800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176312.189687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176312.189693:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe65500 x1872931145516800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176312.189701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145516800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176312.189706:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176312.189709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145516800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176312.189713:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145516928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176312.189723:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176312.189728:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe64a80 x1872931145516928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176312.189735:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145516928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176312.189745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189747:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176312.189749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145516928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176312.189753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145517056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176312.189763:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176312.189768:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe66a00 x1872931145517056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176312.189775:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145517056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176312.189781:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176312.189784:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145517056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176312.189788:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145517184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176312.189798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176312.189804:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe67800 x1872931145517184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176312.189810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145517184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176312.189816:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189818:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176312.189821:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145517184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176312.189825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145517312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176312.189835:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176312.189841:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe67100 x1872931145517312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176312.189848:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145517312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176312.189854:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189856:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176312.189857:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145517312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176312.189861:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145517440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176312.189871:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176312.189876:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176312/real 1786176312]  req@ffff89d99fe66d80 x1872931145517440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176312.189883:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145517440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176312.189889:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176312.189891:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176312.189893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145517440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176312.700966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176312.701068:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176313.213007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176313.725005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176313.725047:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176314.236999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176314.749100:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176314.749179:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176315.261044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176315.773159:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176315.773271:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176316.284988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176316.796974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176316.797053:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176317.309048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176317.309077:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176317.309080:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176317.309087:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176317.309101:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00080000:3.0:1786176317.309120:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176317.309133:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176317.309214:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145517568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176317.309245:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176317.309248:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176317.309250:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176317.309253:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00080000:3.0:1786176317.309257:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176317.309260:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176317.309270:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176317.309281:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145517696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176317.309290:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176317.309293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176317.309294:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176317.309297:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00080000:3.0:1786176317.309300:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176317.309303:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145517568:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176317.309307:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176317.309315:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176317.309325:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145517824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176317.309333:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176317.309336:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176317.309338:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176317.309340:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00080000:3.0:1786176317.309343:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176317.309346:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176317.309350:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176317.309371:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145517952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176317.309379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176317.309382:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176317.309383:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176317.309386:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00080000:3.0:1786176317.309389:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176317.309392:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176317.309395:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176317.309402:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176317.309406:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145518080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176317.309414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176317.309419:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176317.309420:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176317.309434:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00080000:3.0:1786176317.309437:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176317.309440:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176317.309444:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176317.309452:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145518208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176317.309458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176317.309461:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176317.309463:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176317.309466:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00100000:1.0:1786176317.309470:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe64000 x1872931145517568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176317.309471:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176317.309480:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176317.309487:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176317.309500:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145517568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176317.309501:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145518336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176317.309530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176317.309531:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176317.309537:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176317.309540:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176317.309541:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176317.309547:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145517568:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176317.309548:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00080000:3.0:1786176317.309563:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176317.309569:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145517696:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176317.309570:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176317.309579:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176317.309590:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145518464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176317.309598:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176317.309598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176317.309605:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176317.309607:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176317.309613:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10051
00000100:00100000:1.0:1786176317.309616:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe64380 x1872931145517696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176317.309618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176317.309627:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176317.309634:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176317.309647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145517696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176317.309655:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145518592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176317.309664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176317.309672:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176317.309678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145517696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176317.309711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145517824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176317.309730:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176317.309740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe65180 x1872931145517824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176317.309755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145517824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176317.309762:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176317.309765:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176317.309768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145517824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176317.309772:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145517952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176317.309786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176317.309792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe67b80 x1872931145517952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176317.309801:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145517952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176317.309807:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176317.309809:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176317.309811:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145517952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176317.309815:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145518080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176317.309826:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176317.309833:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe65f80 x1872931145518080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176317.309841:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145518080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176317.309864:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176317.309866:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176317.309869:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145518080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176317.309874:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145518208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176317.309888:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176317.309923:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe64700 x1872931145518208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176317.309934:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145518208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176317.309940:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176317.309943:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176317.309946:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145518208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176317.309951:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145518336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176317.309966:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176317.309974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe66300 x1872931145518336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176317.309983:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145518336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176317.309988:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176317.309990:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176317.309993:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145518336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176317.310021:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145518464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176317.310037:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176317.310045:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe66d80 x1872931145518464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176317.310072:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145518464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176317.310081:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176317.310083:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176317.310086:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145518464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176317.310092:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145518592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176317.310110:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176317.310123:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176317/real 1786176317]  req@ffff89d99fe67100 x1872931145518592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176317.310139:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145518592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176317.310151:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176317.310155:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176317.310160:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145518592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176317.821065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176317.821161:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176318.333014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176318.845062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176318.845229:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176319.357117:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176319.868996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176319.869097:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176320.381109:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176320.893030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176320.893154:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176321.405088:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176321.917111:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176321.917305:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176322.429096:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176322.429108:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176322.429110:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176322.429118:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176322.429136:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00080000:3.0:1786176322.429168:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176322.429179:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176322.429237:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145518720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176322.429310:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176322.429314:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176322.429316:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176322.429338:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00080000:3.0:1786176322.429344:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176322.429360:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176322.429371:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176322.429389:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145518848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176322.429401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176322.429405:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176322.429408:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176322.429413:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00080000:3.0:1786176322.429417:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176322.429422:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176322.429427:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176322.429440:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145518976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176322.429452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176322.429458:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145518720:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176322.429458:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176322.429463:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176322.429475:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00080000:3.0:1786176322.429481:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176322.429499:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176322.429506:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176322.429524:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145519104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176322.429536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176322.429540:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176322.429542:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176322.429547:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00080000:3.0:1786176322.429552:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176322.429556:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176322.429561:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176322.429573:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145519232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176322.429584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176322.429590:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176322.429592:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176322.429602:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00100000:1.0:1786176322.429609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145518848:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176322.429611:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176322.429641:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176322.429649:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176322.429675:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145519360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176322.429716:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176322.429720:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176322.429725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145518976:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176322.429726:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176322.429739:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00080000:3.0:1786176322.429745:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176322.429749:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176322.429755:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176322.429781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145519104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176322.429790:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145519488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176322.429803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176322.429807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176322.429810:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176322.429817:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00080000:3.0:1786176322.429822:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176322.429827:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145519232:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176322.429833:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176322.429847:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176322.429893:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145519616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176322.429902:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145519360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176322.429923:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176322.429929:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176322.429952:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176322.429954:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145519488:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176322.429973:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10056
00000100:00080000:3.0:1786176322.430079:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176322.430089:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176322.430095:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145519616:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786176322.430105:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176322.430136:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145519744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176322.430197:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145519744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176322.941116:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176322.941202:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176323.453230:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176323.965035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176323.965199:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176324.477122:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176324.989020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176324.989111:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1786176325.501302:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000100:00100000:2.0:1786176325.501324:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786176325.501363:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786176325.501380:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176325.501419:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786176325.501433:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176325.501435:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe67800 x1872931145518720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176325.501445:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176325.501482:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145518720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176325.501487:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176325.501501:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176325.501513:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176325.501518:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000800:00000100:0.0:1786176325.501526:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176325.501530:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501539:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145518720:192.168.202.130@tcp:250:kworker.0
00000800:00000100:0.0:1786176325.501544:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176325.501557:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe66a00 x1872931145518848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176325.501576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145518848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176325.501587:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176325.501591:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501595:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145518848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176325.501626:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe66d80 x1872931145519744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176325.501640:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145519744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176325.501650:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176325.501654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145519744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176325.501675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe67100 x1872931145519616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176325.501690:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145519616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176325.501699:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176325.501703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145519616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176325.501714:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe65880 x1872931145519360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176325.501726:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145519360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176325.501735:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176325.501739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501743:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145519360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176325.501749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe67480 x1872931145519488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176325.501761:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145519488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176325.501770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176325.501774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501777:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145519488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176325.501784:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe64a80 x1872931145518976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176325.501808:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145518976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176325.501817:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176325.501821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501824:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145518976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176325.501831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe65500 x1872931145519104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176325.501845:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145519104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176325.501854:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176325.501858:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501861:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145519104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176325.501870:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176322/real 1786176325]  req@ffff89d99fe66680 x1872931145519232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176325.501882:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145519232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176325.501891:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176325.501932:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176325.501938:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145519232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176326.013062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176326.013158:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176326.525150:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176327.037007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176327.037124:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176327.549016:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176327.549025:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176327.549030:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176327.549041:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00080000:3.0:1786176327.549054:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176327.549064:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176327.549083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176327.549118:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145519872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176327.549151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176327.549156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176327.549158:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176327.549163:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00080000:3.0:1786176327.549168:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176327.549175:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176327.549186:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176327.549208:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145520000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176327.549211:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145519872:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176327.549236:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176327.549241:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176327.549244:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176327.549250:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00080000:3.0:1786176327.549254:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176327.549259:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176327.549265:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176327.549282:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145520128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176327.549296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176327.549300:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176327.549302:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176327.549306:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00080000:3.0:1786176327.549311:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176327.549323:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176327.549329:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176327.549338:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176327.549347:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145520256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176327.549362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176327.549367:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176327.549369:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176327.549375:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00080000:3.0:1786176327.549380:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176327.549386:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176327.549393:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176327.549404:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe66300 x1872931145519872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176327.549413:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145520384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176327.549446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176327.549451:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176327.549455:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176327.549457:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145519872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176327.549475:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00080000:1.0:1786176327.549482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176327.549484:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176327.549497:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176327.549497:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176327.549513:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176327.549514:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145519872:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176327.549536:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145520512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176327.549551:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176327.549555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176327.549558:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176327.549564:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00080000:3.0:1786176327.549569:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176327.549577:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145520000:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176327.549578:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176327.549593:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176327.549615:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145520640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176327.549632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176327.549638:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176327.549641:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176327.549646:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176327.549655:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00080000:3.0:1786176327.549663:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176327.549671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe64700 x1872931145520000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176327.549672:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176327.549684:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176327.549712:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145520768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176327.549716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145520000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176327.549791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176327.549794:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176327.549798:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176327.549804:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176327.549805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176327.549818:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10061
00000100:00100000:1.0:1786176327.549821:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145520000:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176327.549828:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176327.549839:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145520128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176327.549839:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176327.549857:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176327.549879:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145520896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176327.549894:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176327.550000:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe65f80 x1872931145520128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176327.550016:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145520128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176327.550028:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176327.550032:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176327.550036:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145520128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176327.550044:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145520256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176327.550074:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176327.550099:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe67b80 x1872931145520256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176327.550125:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145520256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176327.550134:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176327.550138:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176327.550142:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145520256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176327.550149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145520384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176327.550175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176327.550188:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe65180 x1872931145520384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176327.550201:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145520384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176327.550211:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176327.550215:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176327.550219:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145520384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176327.550226:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145520512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176327.550250:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176327.550262:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe64380 x1872931145520512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176327.550274:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145520512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176327.550289:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176327.550293:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176327.550297:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145520512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176327.550327:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145520640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176327.550353:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176327.550367:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe64000 x1872931145520640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176327.550380:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145520640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176327.550389:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176327.550394:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176327.550398:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145520640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176327.550407:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145520768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176327.550433:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176327.550450:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe66300 x1872931145520768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176327.550464:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145520768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176327.550472:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176327.550478:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176327.550483:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145520768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176327.550492:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145520896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176327.550517:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176327.550537:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176327/real 1786176327]  req@ffff89d99fe66680 x1872931145520896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176327.550550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145520896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176327.550559:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176327.550562:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176327.550565:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145520896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176328.061033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176328.061099:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176328.573281:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176329.084990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176329.085077:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176329.597009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176330.109020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176330.109131:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176330.621064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176331.133043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176331.133099:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176331.645026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176332.157025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176332.157136:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176332.669070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176332.669111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669123:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176332.669132:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669145:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669159:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669169:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176332.669233:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145521024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176332.669276:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669281:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176332.669285:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669293:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669299:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669305:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176332.669315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145521024:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786176332.669321:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176332.669359:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145521152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176332.669379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669384:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176332.669387:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669395:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669403:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669409:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176332.669418:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176332.669431:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176332.669441:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145521280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176332.669458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669463:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176332.669466:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669472:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669478:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669485:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176332.669493:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176332.669507:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145521408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176332.669520:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669525:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176332.669527:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669533:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669537:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669542:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176332.669550:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176332.669563:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145521536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176332.669574:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176332.669583:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669588:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669593:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669600:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176332.669606:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176332.669619:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2fe680 x1872931145521024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176332.669622:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145521664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176332.669641:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669655:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176332.669662:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669670:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669677:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669682:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176332.669687:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176332.669697:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145521792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176332.669707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669711:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176332.669713:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669718:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669722:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669726:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176332.669731:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176332.669743:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145521920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176332.669753:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176332.669758:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176332.669760:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176332.669766:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10066
00000100:00080000:1.0:1786176332.669770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176332.669774:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176332.669785:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176332.669797:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145522048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176332.669873:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145521024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670049:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670058:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670065:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145521024:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176332.670095:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145521152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176332.670134:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176332.670153:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2fe300 x1872931145521152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176332.670171:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145521152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670182:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670187:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670191:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145521152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176332.670199:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145521280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176332.670219:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176332.670232:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2fdc00 x1872931145521280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176332.670255:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145521280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670265:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670269:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670272:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145521280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176332.670279:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145521408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176332.670298:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176332.670309:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2ff480 x1872931145521408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176332.670324:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145521408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670333:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670336:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670340:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145521408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176332.670346:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145521536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176332.670366:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176332.670376:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2fd880 x1872931145521536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176332.670390:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145521536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670406:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670410:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670414:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145521536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176332.670420:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145521664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176332.670438:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176332.670449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2fce00 x1872931145521664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176332.670462:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145521664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670472:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670476:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670479:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145521664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176332.670485:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145521792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176332.670502:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176332.670520:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2fc700 x1872931145521792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176332.670543:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145521792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670559:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670565:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670573:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145521792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176332.670585:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145521920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176332.670627:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176332.670644:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2fdf80 x1872931145521920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176332.670660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145521920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670674:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145521920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176332.670685:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145522048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176332.670708:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176332.670719:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176332/real 1786176332]  req@ffff89d9ba2ffb80 x1872931145522048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176332.670733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145522048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176332.670742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176332.670746:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176332.670749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145522048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176333.180985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176333.181120:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176333.692995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176334.204980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176334.205082:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176334.717025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176335.229044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176335.229143:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176335.741094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176336.253025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176336.253136:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176336.765041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176337.277073:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176337.277160:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176337.789031:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176337.789034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176337.789050:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176337.789057:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176337.789070:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00080000:3.0:1786176337.789084:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176337.789093:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176337.789143:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145522176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176337.789175:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176337.789179:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176337.789181:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176337.789184:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00080000:3.0:1786176337.789187:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176337.789191:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176337.789202:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176337.789214:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145522304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176337.789225:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176337.789228:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145522176:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176337.789229:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176337.789234:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176337.789243:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00080000:3.0:1786176337.789245:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176337.789249:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176337.789253:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176337.789264:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145522432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176337.789272:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176337.789276:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176337.789277:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176337.789281:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00080000:3.0:1786176337.789284:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176337.789286:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176337.789290:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176337.789298:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145522560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176337.789307:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176337.789310:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176337.789312:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176337.789314:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00080000:3.0:1786176337.789317:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176337.789322:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176337.789324:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176337.789327:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176337.789338:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145522688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176337.789346:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176337.789350:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176337.789352:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176337.789356:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00080000:3.0:1786176337.789380:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176337.789388:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176337.789397:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176337.789403:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe65500 x1872931145522176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176337.789425:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145522816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176337.789437:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145522176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176337.789473:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176337.789486:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176337.789492:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176337.789498:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176337.789500:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00080000:1.0:1786176337.789508:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176337.789508:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176337.789519:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176337.789520:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145522176:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176337.789549:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176337.789579:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145522944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176337.789584:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145522304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176337.789625:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176337.789631:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176337.789635:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176337.789642:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176337.789648:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00080000:3.0:1786176337.789654:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176337.789662:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe64a80 x1872931145522304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176337.789663:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176337.789674:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176337.789688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145522304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176337.789695:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145523072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176337.789705:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176337.789713:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176337.789714:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176337.789723:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176337.789724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145522304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176337.789728:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176337.789738:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10072
00000100:00100000:1.0:1786176337.789739:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145522432:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176337.789763:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176337.789773:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176337.789785:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176337.789796:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176337.789800:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe67480 x1872931145522432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176337.789819:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145523200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176337.789824:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145522432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176337.789849:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176337.789854:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176337.789873:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145522432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176337.789881:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145522560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176337.789926:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176337.789938:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe65880 x1872931145522560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176337.789948:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145522560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176337.789955:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176337.789958:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176337.789961:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145522560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176337.789966:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145522688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176337.789981:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176337.789988:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe67100 x1872931145522688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176337.790005:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145522688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176337.790011:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176337.790013:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176337.790015:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145522688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176337.790020:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145522816:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176337.790032:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176337.790040:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe66d80 x1872931145522816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176337.790049:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145522816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176337.790055:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176337.790058:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176337.790060:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145522816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176337.790080:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145522944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176337.790093:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176337.790101:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe66a00 x1872931145522944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176337.790110:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145522944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176337.790122:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176337.790124:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176337.790128:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145522944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176337.790135:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145523072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176337.790158:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176337.790172:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe67800 x1872931145523072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176337.790188:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145523072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176337.790200:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176337.790203:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176337.790206:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145523072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176337.790212:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145523200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176337.790230:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176337.790239:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176337/real 1786176337]  req@ffff89d99fe65500 x1872931145523200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176337.790249:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145523200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176337.790256:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176337.790259:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176337.790262:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145523200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176338.301031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176338.301227:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176338.813054:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176339.325023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176339.325101:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176339.837124:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176340.348988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176340.349167:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176340.861002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176341.373102:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176341.373102:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786176341.884971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176342.397021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176342.397110:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176342.909057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176342.909084:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176342.909089:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176342.909101:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10077
00000100:00100000:2.0:1786176342.909109:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176342.909112:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176342.909123:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176342.909187:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145523328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176342.909241:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176342.909248:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176342.909251:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176342.909257:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10077
00000100:00080000:3.0:1786176342.909264:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176342.909271:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176342.909285:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176342.909317:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145523456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176342.909332:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176342.909337:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176342.909341:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176342.909347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145523328:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176342.909349:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10077
00000100:00080000:3.0:1786176342.909362:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176342.909370:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176342.909376:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176342.909393:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145523584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176342.909405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176342.909410:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176342.909412:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176342.909426:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10077
00000100:00080000:3.0:1786176342.909431:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176342.909436:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176342.909443:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176342.909458:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145523712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176342.909473:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176342.909476:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176342.909482:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176342.909484:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176342.909491:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10077
00000100:00080000:3.0:1786176342.909496:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176342.909502:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176342.909508:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176342.909522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145523840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176342.909535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176342.909544:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe66680 x1872931145523328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176342.909544:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176342.909552:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176342.909568:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10077
00000100:00080000:3.0:1786176342.909577:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176342.909585:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176342.909591:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145523328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176342.909595:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176342.909623:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176342.909631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176342.909639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145523968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176342.909643:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145523328:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176342.909680:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176342.909686:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176342.909689:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145523456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176342.909691:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176342.909707:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10077
00000100:00080000:3.0:1786176342.909713:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176342.909719:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176342.909727:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176342.909734:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176342.909754:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145524096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176342.909761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe66300 x1872931145523456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176342.909825:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176342.909828:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145523456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176342.909860:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176342.909868:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176342.909870:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176342.909878:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10077
00000100:00080000:1.0:1786176342.909882:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176342.909889:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176342.909893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145523456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176342.909899:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176342.909909:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176342.909952:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145523584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176342.909954:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145524224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176342.909976:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176342.909980:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176342.909983:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176342.909991:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10077
00000800:00000100:1.0:1786176342.910001:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176342.910005:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176342.910013:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176342.910020:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176342.910023:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe64000 x1872931145523584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176342.910043:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145524352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176342.910046:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145523584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176342.910102:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176342.910121:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176342.910128:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145523584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176342.910137:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145523712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176342.910165:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176342.910178:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe64380 x1872931145523712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176342.910190:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145523712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176342.910198:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176342.910201:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176342.910205:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145523712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176342.910211:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145523840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176342.910232:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176342.910244:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe65180 x1872931145523840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176342.910263:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145523840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176342.910271:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176342.910275:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176342.910277:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145523840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176342.910283:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145523968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176342.910314:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176342.910326:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe67b80 x1872931145523968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176342.910338:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145523968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176342.910346:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176342.910349:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176342.910353:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145523968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176342.910379:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145524096:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176342.910399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176342.910410:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe65f80 x1872931145524096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176342.910421:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145524096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176342.910436:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176342.910439:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176342.910443:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145524096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176342.910450:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145524224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176342.910469:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176342.910480:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe64700 x1872931145524224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176342.910492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145524224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176342.910501:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176342.910505:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176342.910508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145524224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176342.910515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145524352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176342.910534:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176342.910546:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176342/real 1786176342]  req@ffff89d99fe66680 x1872931145524352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176342.910558:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145524352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176342.910577:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176342.910580:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176342.910584:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145524352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176343.421090:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176343.421136:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176343.933041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176344.444986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176344.445046:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176344.957011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176345.469021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176345.469094:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176345.981016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176346.492995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176346.493103:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176347.005015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176347.517122:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176347.517127:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00080000:3.0:1786176348.029037:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176348.029043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176348.029053:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176348.029060:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176348.029072:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00080000:3.0:1786176348.029083:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176348.029092:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176348.029134:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145524480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176348.029181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176348.029185:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176348.029187:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176348.029191:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00080000:3.0:1786176348.029196:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176348.029200:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176348.029210:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176348.029224:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145524608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176348.029235:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176348.029240:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176348.029244:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176348.029248:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00080000:3.0:1786176348.029251:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176348.029254:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176348.029259:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176348.029269:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145524736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176348.029281:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145524480:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176348.029285:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176348.029301:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176348.029304:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176348.029309:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00080000:3.0:1786176348.029312:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176348.029315:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176348.029320:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176348.029339:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145524864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176348.029349:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176348.029352:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176348.029355:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176348.029359:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00080000:3.0:1786176348.029363:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176348.029366:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176348.029372:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176348.029381:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145524992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176348.029391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176348.029401:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176348.029403:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176348.029406:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176348.029411:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00080000:3.0:1786176348.029416:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176348.029421:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176348.029428:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176348.029442:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145525120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176348.029453:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176348.029457:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176348.029459:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176348.029464:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00080000:3.0:1786176348.029468:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176348.029470:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe65500 x1872931145524480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176348.029475:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176348.029490:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176348.029516:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145525248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176348.029519:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145524480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176348.029573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176348.029579:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176348.029579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176348.029592:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176348.029596:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176348.029605:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00100000:1.0:1786176348.029610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145524480:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176348.029616:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176348.029628:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176348.029633:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145524608:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176348.029640:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176348.029670:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145525376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176348.029680:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176348.029703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176348.029705:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe67800 x1872931145524608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176348.029711:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176348.029718:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176348.029742:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10082
00000100:00080000:3.0:1786176348.029752:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176348.029755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145524608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176348.029781:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176348.029801:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176348.029806:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176348.029812:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176348.029821:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145524608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176348.029823:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145525504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176348.029954:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145524736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176348.029987:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176348.029999:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe66a00 x1872931145524736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176348.030009:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145524736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176348.030016:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176348.030018:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176348.030021:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145524736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176348.030026:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145524864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176348.030040:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176348.030047:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe66d80 x1872931145524864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176348.030056:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145524864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176348.030062:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176348.030064:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176348.030066:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145524864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176348.030077:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145524992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176348.030091:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176348.030099:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe67100 x1872931145524992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176348.030108:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145524992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176348.030114:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176348.030117:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176348.030119:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145524992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176348.030123:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145525120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176348.030135:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176348.030142:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe65880 x1872931145525120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176348.030153:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145525120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176348.030162:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176348.030166:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176348.030170:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145525120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176348.030178:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145525248:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176348.030202:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176348.030215:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe67480 x1872931145525248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176348.030224:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145525248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176348.030231:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176348.030233:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176348.030236:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145525248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176348.030241:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145525376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176348.030256:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176348.030264:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe64a80 x1872931145525376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176348.030272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145525376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176348.030278:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176348.030280:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176348.030282:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145525376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176348.030286:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145525504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176348.030297:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176348.030303:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176348/real 1786176348]  req@ffff89d99fe66680 x1872931145525504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176348.030312:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145525504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176348.030317:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176348.030319:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176348.030322:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145525504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176348.540982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176348.541054:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176349.052987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176349.565038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176349.565108:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176350.076989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176350.588999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176350.589056:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176351.101014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176351.613072:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176351.613109:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176352.124983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176352.637022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176352.637066:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176353.148955:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176353.148964:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176353.148968:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176353.148977:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00080000:3.0:1786176353.148986:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.148993:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176353.149003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176353.149027:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145525632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176353.149050:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176353.149053:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176353.149054:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176353.149057:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00080000:3.0:1786176353.149060:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.149063:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176353.149071:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176353.149080:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145525632:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176353.149083:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145525760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176353.149095:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176353.149097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176353.149099:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176353.149102:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00080000:3.0:1786176353.149105:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.149107:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176353.149110:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176353.149119:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145525888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176353.149126:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176353.149128:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176353.149130:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176353.149132:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00080000:3.0:1786176353.149136:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.149138:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176353.149141:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176353.149147:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176353.149153:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145526016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176353.149160:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176353.149163:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176353.149164:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176353.149167:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00080000:3.0:1786176353.149169:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.149171:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176353.149174:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176353.149182:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145526144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176353.149188:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176353.149190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176353.149192:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176353.149195:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe64700 x1872931145525632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176353.149197:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00080000:3.0:1786176353.149203:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.149209:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176353.149216:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176353.149227:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145525632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176353.149228:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145526272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176353.149263:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149271:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176353.149276:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176353.149277:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145525632:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176353.149287:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176353.149290:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176353.149294:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00080000:3.0:1786176353.149298:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.149301:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176353.149306:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145525760:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176353.149306:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176353.149320:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145526400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176353.149329:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176353.149332:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786176353.149334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176353.149335:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176353.149342:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00080000:3.0:1786176353.149345:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.149348:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176353.149350:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176353.149359:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145526528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176353.149364:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe65f80 x1872931145525760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176353.149369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176353.149377:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176353.149381:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176353.149389:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10087
00000100:00100000:1.0:1786176353.149394:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145525760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176353.149394:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176353.149401:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176353.149408:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176353.149412:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149419:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176353.149419:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145526656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176353.149427:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145525760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176353.149437:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145525888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176353.149454:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176353.149463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe67b80 x1872931145525888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176353.149471:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145525888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176353.149477:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149479:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176353.149481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145525888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176353.149485:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145526016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176353.149496:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176353.149502:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe65180 x1872931145526016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176353.149510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145526016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176353.149516:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149517:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176353.149519:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145526016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176353.149523:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145526144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176353.149539:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176353.149550:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe64380 x1872931145526144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176353.149564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145526144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176353.149573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149577:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176353.149581:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145526144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176353.149587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145526272:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176353.149603:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176353.149612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe64000 x1872931145526272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176353.149620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145526272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176353.149626:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149628:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176353.149630:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145526272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176353.149646:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145526400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176353.149657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176353.149664:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe66300 x1872931145526400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176353.149671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145526400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176353.149681:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149683:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176353.149685:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145526400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176353.149688:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145526528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176353.149698:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176353.149704:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe64700 x1872931145526528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176353.149739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145526528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176353.149745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149748:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176353.149750:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145526528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176353.149754:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145526656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176353.149769:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176353.149776:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176353/real 1786176353]  req@ffff89d99fe66680 x1872931145526656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176353.149787:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145526656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176353.149795:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176353.149798:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176353.149802:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145526656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176353.660974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176353.661075:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176354.173098:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176354.685068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176354.685116:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176355.197003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176355.709091:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176355.709130:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786176356.221005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176356.733181:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176356.733191:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176357.245078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176357.757119:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176357.757174:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176358.269021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176358.269043:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176358.269055:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176358.269062:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176358.269076:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10092
00000100:00080000:3.0:1786176358.269093:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176358.269106:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176358.269168:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145526784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176358.269220:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176358.269227:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176358.269232:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176358.269241:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10092
00000100:00080000:3.0:1786176358.269249:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176358.269257:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176358.269270:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176358.269280:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145526784:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176358.269299:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145526912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176358.269342:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176358.269351:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176358.269355:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176358.269363:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10092
00000100:00080000:3.0:1786176358.269373:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176358.269381:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176358.269390:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176358.269394:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176358.269427:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145527040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176358.269445:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176358.269451:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176358.269454:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176358.269458:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe64a80 x1872931145526784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176358.269468:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10092
00000100:00080000:3.0:1786176358.269491:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176358.269503:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176358.269524:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176358.269527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145526784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176358.269552:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176358.269562:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176358.269565:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145527168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176358.269571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145526784:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176358.269603:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176358.269609:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176358.269615:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176358.269639:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145526912:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176358.269640:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10092
00000100:00080000:3.0:1786176358.269680:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176358.269691:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176358.269702:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176358.269717:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176358.269732:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145527296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176358.269741:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe67480 x1872931145526912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176358.269796:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145526912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176358.269815:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176358.269817:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176358.269827:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176358.269831:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176358.269835:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145526912:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176358.269840:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176358.269848:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145527040:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176358.269855:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10092
00000100:00080000:3.0:1786176358.269869:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176358.269881:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176358.269881:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176358.269959:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe65880 x1872931145527040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176358.269959:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176358.269994:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145527040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176358.270009:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145527424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176358.270012:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176358.270028:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176358.270044:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145527040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176358.270069:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145527168:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176358.270072:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176358.270084:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176358.270088:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176358.270100:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10092
00000800:00000100:1.0:1786176358.270102:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176358.270116:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176358.270124:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe67100 x1872931145527168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176358.270134:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176358.270153:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145527168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176358.270156:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176358.270184:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176358.270189:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176358.270194:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145527168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176358.270203:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145527552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176358.270223:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145527296:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176358.270231:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176358.270239:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176358.270245:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176358.270252:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176358.270269:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10092
00000100:00100000:1.0:1786176358.270275:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe66d80 x1872931145527296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176358.270287:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176358.270296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145527296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176358.270306:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176358.270330:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786176358.270334:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176358.270338:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176358.270349:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145527296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176358.270357:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145527424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176358.270375:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145527680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176358.270388:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176358.270401:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe66a00 x1872931145527424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176358.270411:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176358.270427:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176358.270428:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145527424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176358.270441:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176358.270451:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176358.270458:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176358.270461:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10092
00000100:00100000:1.0:1786176358.270467:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145527424:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176358.270477:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176358.270491:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145527552:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176358.270494:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176358.270509:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176358.270519:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176358.270536:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe67800 x1872931145527552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176358.270545:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145527808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176358.270562:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145527552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176358.270612:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176358.270618:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176358.270624:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145527552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176358.270630:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145527680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176358.270653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176358.270688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe65500 x1872931145527680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176358.270700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145527680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176358.270708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176358.270711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176358.270714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145527680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176358.270727:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145527808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176358.270746:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176358.270756:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176358/real 1786176358]  req@ffff89d99fe66a00 x1872931145527808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176358.270767:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145527808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176358.270774:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176358.270777:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176358.270781:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145527808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176358.781042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176358.781119:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176359.293041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176359.805020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176359.805089:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176360.317006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176360.829003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176360.829065:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176361.340974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176361.853046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176361.853075:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176362.365005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176362.877116:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176362.877116:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786176363.389020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176363.389032:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176363.389041:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176363.389046:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176363.389058:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389068:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176363.389075:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176363.389110:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145527936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176363.389133:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176363.389136:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176363.389137:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176363.389140:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389143:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176363.389146:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176363.389155:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176363.389164:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145528064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176363.389173:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145527936:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176363.389185:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176363.389187:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176363.389189:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176363.389194:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389197:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176363.389200:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176363.389204:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176363.389213:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145528192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176363.389221:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176363.389223:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176363.389226:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176363.389229:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389233:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176363.389235:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176363.389240:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176363.389248:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145528320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176363.389256:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176363.389260:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176363.389265:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176363.389267:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176363.389273:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389276:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176363.389279:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176363.389285:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176363.389294:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145528448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176363.389301:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176363.389304:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176363.389305:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176363.389309:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389314:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176363.389319:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176363.389324:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176363.389334:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe66d80 x1872931145527936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176363.389335:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145528576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176363.389421:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145527936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176363.389422:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176363.389443:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176363.389446:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176363.389448:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176363.389453:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176363.389480:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145527936:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176363.389481:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389499:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176363.389508:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176363.389514:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176363.389527:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145528704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176363.389549:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145528064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176363.389550:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176363.389569:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176363.389571:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176363.389575:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389578:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176363.389582:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176363.389587:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176363.389601:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176363.389602:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145528832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176363.389633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe67100 x1872931145528064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176363.389644:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176363.389654:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176363.389656:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176363.389661:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145528064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176363.389664:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10097
00000100:00080000:3.0:1786176363.389677:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176363.389689:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176363.389690:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176363.389704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176363.389704:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176363.389714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145528064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176363.389723:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145528960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176363.389726:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145528192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176363.389759:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176363.389770:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe65880 x1872931145528192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176363.389780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145528192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176363.389786:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176363.389788:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176363.389791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145528192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176363.389795:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145528320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176363.389807:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176363.389813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe67480 x1872931145528320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176363.389820:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145528320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176363.389826:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176363.389827:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176363.389829:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145528320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176363.389833:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145528448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176363.389843:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176363.389849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe64a80 x1872931145528448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176363.389857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145528448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176363.389862:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176363.389863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176363.389865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145528448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176363.389869:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145528576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176363.389879:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176363.389884:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe66680 x1872931145528576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176363.389891:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145528576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176363.389928:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176363.389931:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176363.389933:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145528576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176363.389952:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145528704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176363.389967:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176363.389974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe64700 x1872931145528704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176363.389982:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145528704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176363.389992:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176363.389995:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176363.389997:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145528704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176363.390000:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145528832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176363.390011:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176363.390017:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe66300 x1872931145528832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176363.390024:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145528832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176363.390031:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176363.390035:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176363.390039:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145528832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176363.390046:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145528960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176363.390067:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176363.390080:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176363/real 1786176363]  req@ffff89d99fe64000 x1872931145528960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176363.390093:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145528960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176363.390099:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176363.390101:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176363.390139:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145528960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176363.900999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176363.901063:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176364.413027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176364.925011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176364.925112:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176365.437122:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176365.948985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176365.949042:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176366.461002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176366.973027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176366.973099:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176367.485035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176367.997038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176367.997107:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176368.509035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176368.509089:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176368.509096:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176368.509100:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.509110:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00080000:3.0:1786176368.509119:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176368.509125:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176368.509157:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145529088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176368.509179:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176368.509182:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176368.509184:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.509187:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00080000:3.0:1786176368.509189:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176368.509192:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176368.509200:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176368.509216:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145529216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176368.509230:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176368.509232:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176368.509234:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.509238:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00080000:3.0:1786176368.509241:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176368.509246:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145529088:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176368.509248:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176368.509260:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176368.509269:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145529344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176368.509277:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176368.509279:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176368.509281:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.509287:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00080000:3.0:1786176368.509289:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176368.509345:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176368.509354:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176368.509362:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176368.509376:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145529472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176368.509383:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176368.509387:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176368.509389:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.509394:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00080000:3.0:1786176368.509399:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176368.509403:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176368.509407:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176368.509409:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe64380 x1872931145529088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176368.509420:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145529600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176368.509440:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176368.509445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145529088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176368.509445:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176368.509449:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.509464:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00080000:3.0:1786176368.509476:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176368.509480:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176368.509483:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176368.509491:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145529728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176368.509493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.509510:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176368.509510:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176368.509527:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145529088:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176368.509535:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176368.509544:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.509550:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00100000:0.0:1786176368.509578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145529216:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176368.509608:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176368.509621:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe65180 x1872931145529216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176368.509633:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145529216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176368.509641:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.509646:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176368.509650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145529216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176368.509657:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145529344:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176368.509671:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176368.509680:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176368.509687:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176368.509698:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176368.509700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe67b80 x1872931145529344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176368.509726:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145529344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176368.509736:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.509742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176368.509751:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145529344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176368.509762:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145529472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176368.509788:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176368.509797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe65f80 x1872931145529472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176368.509810:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145529856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176368.509811:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145529472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176368.509903:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.509909:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176368.509931:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176368.509934:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176368.509937:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.509942:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00100000:0.0:1786176368.509955:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145529472:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176368.509955:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176368.509972:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176368.509978:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145529600:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786176368.509981:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176368.510008:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145529984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176368.510029:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176368.510031:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176368.510033:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176368.510037:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10102
00000100:00080000:3.0:1786176368.510039:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176368.510042:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176368.510047:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176368.510053:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176368.510065:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe64000 x1872931145529600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176368.510070:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145530112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176368.510153:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145529600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176368.510172:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.510179:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176368.510186:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145529600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176368.510204:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145529728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176368.510235:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176368.510252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe66300 x1872931145529728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176368.510269:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145529728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176368.510279:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.510285:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176368.510289:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145529728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176368.510310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145529856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176368.510325:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176368.510333:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe64700 x1872931145529856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176368.510349:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145529856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176368.510356:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.510358:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176368.510360:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145529856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176368.510365:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145529984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176368.510390:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176368.510397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe66680 x1872931145529984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176368.510407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145529984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176368.510413:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.510415:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176368.510418:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145529984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176368.510422:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145530112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176368.510434:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176368.510440:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176368/real 1786176368]  req@ffff89d99fe64a80 x1872931145530112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176368.510450:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145530112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176368.510462:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176368.510465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176368.510467:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145530112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176369.021112:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176369.021227:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176369.533029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176370.045003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176370.045061:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176370.556991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176371.069016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176371.069099:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176371.581053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176372.093003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176372.093062:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176372.605022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176373.116997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176373.117133:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176373.629067:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176373.629076:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1786176373.629078:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176373.629097:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176373.629110:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629120:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629128:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176373.629185:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145530240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176373.629214:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176373.629216:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176373.629218:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176373.629221:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629223:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629226:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176373.629250:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176373.629260:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145530368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176373.629267:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176373.629270:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176373.629271:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176373.629274:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629276:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629279:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176373.629282:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176373.629290:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145530496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176373.629298:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176373.629301:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176373.629302:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176373.629308:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145530240:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176373.629308:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629328:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629330:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176373.629334:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176373.629347:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145530624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176373.629354:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176373.629356:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176373.629358:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176373.629360:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629362:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629364:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176373.629368:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176373.629375:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145530752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176373.629381:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176373.629384:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176373.629386:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176373.629389:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629392:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629397:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786176373.629399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176373.629402:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176373.629411:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145530880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176373.629418:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176373.629421:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176373.629422:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176373.629425:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629427:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629430:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176373.629433:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176373.629440:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145531008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176373.629446:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176373.629448:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176373.629450:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176373.629454:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe67480 x1872931145530240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176373.629456:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629462:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629468:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176373.629476:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176373.629485:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145530240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176373.629487:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145531136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176373.629528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176373.629534:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176373.629535:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.629543:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145530240:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176373.629544:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176373.629550:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176373.629554:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145530368:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176373.629560:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10107
00000100:00080000:3.0:1786176373.629567:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176373.629572:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176373.629579:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176373.629583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176373.629601:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe65880 x1872931145530368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176373.629602:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145531264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176373.629628:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145530368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176373.629637:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176373.629639:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.629642:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145530368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176373.629663:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145530496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176373.629676:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176373.629684:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe67100 x1872931145530496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176373.629692:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145530496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176373.629697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176373.629699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.629701:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145530496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176373.629722:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145530624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176373.629734:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176373.629740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe66d80 x1872931145530624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176373.629748:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145530624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176373.629753:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176373.629756:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.629758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145530624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176373.629761:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145530752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176373.629786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176373.629792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe66a00 x1872931145530752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176373.629800:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145530752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176373.629805:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176373.629808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.629810:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145530752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176373.629813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145530880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176373.629824:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176373.629830:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe65500 x1872931145530880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176373.629837:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145530880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176373.629843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176373.629845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.629847:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145530880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176373.629851:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145531008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176373.629861:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176373.629867:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe67800 x1872931145531008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176373.629875:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145531008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176373.629880:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176373.629882:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.629884:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145531008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176373.629887:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145531136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176373.629897:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176373.629903:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe64a80 x1872931145531136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176373.629910:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145531136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176373.629915:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176373.629917:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.629919:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145531136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176373.629923:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145531264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176373.629981:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176373.629989:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176373/real 1786176373]  req@ffff89d99fe66680 x1872931145531264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176373.629997:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145531264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176373.630003:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176373.630005:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176373.630007:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145531264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176374.141033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176374.141109:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176374.653031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176375.165138:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176375.165200:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786176375.677047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176376.189094:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176376.189169:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176376.701051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176377.212996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176377.213077:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176377.725001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176378.237024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176378.237116:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176378.748989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176378.749024:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749030:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176378.749034:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749042:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00080000:3.0:1786176378.749051:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176378.749068:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176378.749102:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145531392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176378.749124:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749126:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176378.749128:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749131:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00080000:3.0:1786176378.749134:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176378.749138:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176378.749146:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176378.749154:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145531392:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176378.749157:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145531520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176378.749167:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749169:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176378.749170:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749173:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00080000:3.0:1786176378.749175:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176378.749177:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176378.749181:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176378.749191:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145531648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176378.749198:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749201:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176378.749202:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749204:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00080000:3.0:1786176378.749207:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176378.749210:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176378.749213:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176378.749219:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176378.749224:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145531776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176378.749233:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749236:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176378.749238:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749242:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00080000:3.0:1786176378.749271:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176378.749275:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176378.749282:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176378.749284:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe64700 x1872931145531392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176378.749301:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145531904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176378.749310:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145531392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176378.749319:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749327:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176378.749330:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749336:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00080000:0.0:1786176378.749337:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176378.749341:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176378.749345:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176378.749350:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176378.749353:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145531392:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176378.749367:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176378.749379:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145532032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176378.749388:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145531520:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176378.749389:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749398:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176378.749400:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749405:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00080000:3.0:1786176378.749409:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176378.749412:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176378.749416:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786176378.749421:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176378.749429:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145532160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176378.749437:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe66300 x1872931145531520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176378.749441:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749449:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176378.749453:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749475:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00100000:0.0:1786176378.749479:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145531520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176378.749481:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176378.749506:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176378.749514:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176378.749515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176378.749520:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176378.749523:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145531520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176378.749527:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145532288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176378.749533:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145531648:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176378.749541:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176378.749545:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176378.749547:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176378.749551:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10112
00000100:00080000:3.0:1786176378.749554:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176378.749559:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176378.749562:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176378.749567:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176378.749572:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe64000 x1872931145531648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176378.749578:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145532416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176378.749587:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145531648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176378.749595:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176378.749608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176378.749610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145531648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176378.749616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145531776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176378.749628:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176378.749634:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe65f80 x1872931145531776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176378.749642:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145531776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176378.749647:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176378.749648:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176378.749650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145531776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176378.749653:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145531904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176378.749663:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176378.749677:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe67b80 x1872931145531904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176378.749684:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145531904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176378.749689:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176378.749691:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176378.749692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145531904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176378.749719:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145532032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176378.749731:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176378.749740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe65180 x1872931145532032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176378.749747:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145532032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176378.749753:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176378.749755:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176378.749758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145532032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176378.749761:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145532160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176378.749771:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176378.749777:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe64380 x1872931145532160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176378.749784:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145532160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176378.749790:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176378.749792:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176378.749794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145532160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176378.749797:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145532288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176378.749822:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176378.749828:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe64700 x1872931145532288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176378.749835:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145532288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176378.749840:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176378.749842:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176378.749845:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145532288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176378.749848:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145532416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176378.749858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176378.749863:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176378/real 1786176378]  req@ffff89d99fe66680 x1872931145532416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176378.749870:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145532416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176378.749875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176378.749877:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176378.749879:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145532416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176379.261020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176379.261122:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176379.773089:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176380.285019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176380.285077:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176380.797000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176381.309006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176381.309098:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176381.821059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176382.333044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176382.333205:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176382.845120:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176383.357020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176383.357090:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176383.869028:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176383.869034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176383.869039:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176383.869044:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176383.869054:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00080000:3.0:1786176383.869064:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176383.869075:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176383.869111:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145532544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176383.869135:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176383.869137:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176383.869139:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176383.869142:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00080000:3.0:1786176383.869144:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176383.869146:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176383.869153:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176383.869163:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145532672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176383.869171:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176383.869174:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176383.869176:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176383.869181:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00100000:0.0:1786176383.869183:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145532544:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176383.869184:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176383.869191:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176383.869196:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176383.869205:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145532800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176383.869212:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176383.869215:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176383.869217:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176383.869219:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00080000:3.0:1786176383.869221:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176383.869223:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176383.869227:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176383.869235:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145532928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176383.869242:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176383.869245:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176383.869248:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786176383.869249:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176383.869253:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00080000:3.0:1786176383.869257:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176383.869260:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176383.869263:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176383.869273:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145533056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176383.869279:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176383.869281:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176383.869282:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176383.869285:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00080000:3.0:1786176383.869287:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176383.869290:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176383.869293:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176383.869298:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe64a80 x1872931145532544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176383.869303:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145533184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176383.869324:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176383.869327:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786176383.869329:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145532544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176383.869330:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176383.869339:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00080000:3.0:1786176383.869344:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176383.869351:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176383.869359:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786176383.869362:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869369:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176383.869369:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145533312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176383.869377:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145532544:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176383.869387:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176383.869390:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145532672:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176383.869391:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176383.869396:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176383.869402:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00080000:3.0:1786176383.869404:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176383.869407:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176383.869427:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176383.869431:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176383.869443:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145533440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176383.869448:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe67800 x1872931145532672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176383.869462:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176383.869466:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786176383.869468:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145532672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176383.869469:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176383.869482:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10118
00000100:00080000:0.0:1786176383.869483:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869489:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176383.869490:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176383.869493:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145532672:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176383.869500:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176383.869508:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176383.869518:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145532800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176383.869524:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145533568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176383.869537:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176383.869550:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe65500 x1872931145532800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176383.869561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145532800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176383.869568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176383.869572:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145532800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176383.869576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145532928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176383.869588:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176383.869594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe66a00 x1872931145532928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176383.869601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145532928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176383.869607:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176383.869610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145532928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176383.869614:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145533056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176383.869624:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176383.869629:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe66d80 x1872931145533056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176383.869636:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145533056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176383.869641:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869643:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176383.869645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145533056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176383.869648:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145533184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176383.869658:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176383.869663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe67100 x1872931145533184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176383.869671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145533184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176383.869676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869678:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176383.869680:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145533184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176383.869683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145533312:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176383.869693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176383.869698:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe65880 x1872931145533312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176383.869706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145533312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176383.869711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176383.869715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145533312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176383.869718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145533440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176383.869727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176383.869732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe67480 x1872931145533440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176383.869739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145533440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176383.869749:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176383.869753:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145533440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176383.869764:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145533568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176383.869774:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176383.869780:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176383/real 1786176383]  req@ffff89d99fe67800 x1872931145533568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176383.869787:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145533568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176383.869793:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176383.869795:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176383.869796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145533568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176384.381074:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176384.381125:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176384.893043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176385.405023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176385.405142:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176385.917021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176386.428996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176386.429073:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176386.941040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176387.453011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176387.453080:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176387.965016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176388.477010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176388.477106:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176388.989015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176388.989053:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176388.989058:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176388.989062:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989070:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989078:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176388.989085:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176388.989122:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145533696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176388.989147:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176388.989150:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176388.989151:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989154:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989156:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176388.989159:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176388.989167:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176388.989176:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145533824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176388.989186:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176388.989187:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145533696:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176388.989197:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176388.989199:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989203:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989208:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176388.989213:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176388.989219:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176388.989235:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145533952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176388.989246:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176388.989250:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176388.989253:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989257:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989263:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176388.989266:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176388.989270:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176388.989282:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145534080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176388.989290:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176388.989293:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176388.989294:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989298:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989301:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176388.989304:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145533824:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176388.989307:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176388.989313:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176388.989324:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145534208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176388.989332:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176388.989334:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176388.989336:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989339:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989342:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176388.989345:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176388.989349:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176388.989352:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145533952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176388.989377:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145534336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176388.989387:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176388.989390:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176388.989392:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989395:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989398:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176388.989403:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145534080:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176388.989404:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176388.989411:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176388.989423:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145534464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176388.989430:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176388.989433:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176388.989434:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989438:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989441:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176388.989444:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145534208:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176388.989447:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176388.989457:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176388.989467:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145534592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176388.989477:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176388.989481:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176388.989481:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145534336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176388.989486:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176388.989493:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10123
00000100:00080000:0.0:1786176388.989497:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176388.989499:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176388.989503:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176388.989517:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145534720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176388.989517:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145534464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176388.989555:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145534592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176388.989578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145534720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176389.501051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176389.501118:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176390.013064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176390.525066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176390.525117:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176391.037075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176391.549004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176391.549060:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176392.061102:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786176392.061226:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786176392.061272:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786176392.061290:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176392.061357:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786176392.061371:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176392.061379:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176392.061393:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176392.061408:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176392.061422:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176392.061425:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f3100 x1872931145534720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176392.061437:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176392.061456:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176392.061483:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145534720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061503:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061510:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061516:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145534720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176392.061526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f1500 x1872931145534208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176392.061552:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145534208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061562:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061566:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061582:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145534208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176392.061591:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f0e00 x1872931145534336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176392.061606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145534336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061619:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061622:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145534336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176392.061642:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f1880 x1872931145534464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176392.061655:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145534464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061662:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061666:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061668:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145534464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176392.061676:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f2680 x1872931145533824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176392.061688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145533824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061696:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061700:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061703:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145533824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176392.061716:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f2a00 x1872931145533952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176392.061729:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145533952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061741:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061744:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145533952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176392.061751:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f2d80 x1872931145534080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176392.061767:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145534080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061774:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061780:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145534080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176392.061788:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f0700 x1872931145533696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176392.061800:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145533696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061808:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061811:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145533696:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176392.061866:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176388/real 1786176392]  req@ffff89d9870f3480 x1872931145534592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176392.061879:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145534592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176413 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176392.061888:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176392.061893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176392.061922:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145534592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176392.573007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176392.573068:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176393.085058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176393.597023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176393.597085:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176394.109032:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176394.109041:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786176394.109043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176394.109045:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176394.109056:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10128
00000100:00080000:3.0:1786176394.109065:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176394.109072:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176394.109103:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145534848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176394.109128:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176394.109131:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176394.109133:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176394.109137:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10128
00000100:00080000:3.0:1786176394.109142:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176394.109148:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176394.109159:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176394.109180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145534848:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176394.109181:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145534976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176394.109207:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176394.109210:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176394.109213:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176394.109219:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10128
00000100:00080000:3.0:1786176394.109225:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176394.109229:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176394.109235:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176394.109251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145535104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176394.109262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176394.109265:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176394.109266:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176394.109269:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10128
00000100:00080000:3.0:1786176394.109273:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176394.109277:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176394.109282:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176394.109290:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176394.109299:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145535232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176394.109345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176394.109350:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176394.109353:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176394.109361:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10128
00000100:00080000:3.0:1786176394.109367:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176394.109374:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe64a80 x1872931145534848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176394.109380:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176394.109399:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176394.109414:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145534848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176394.109425:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145535360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176394.109431:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.109446:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176394.109457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176394.109462:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145534848:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176394.109464:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176394.109473:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176394.109483:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10128
00000100:00080000:3.0:1786176394.109489:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176394.109494:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176394.109499:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176394.109511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145534976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176394.109522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145535488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176394.109540:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176394.109544:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176394.109546:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176394.109553:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10128
00000800:00000100:1.0:1786176394.109564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176394.109568:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176394.109576:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176394.109584:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176394.109592:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe66680 x1872931145534976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176394.109601:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145535616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176394.109614:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176394.109618:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176394.109619:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176394.109627:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10128
00000100:00080000:3.0:1786176394.109632:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176394.109635:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145534976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176394.109642:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176394.109662:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176394.109667:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.109676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176394.109681:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145534976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176394.109694:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145535744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176394.109695:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145535104:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176394.109728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176394.109733:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176394.109736:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176394.109744:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176394.109752:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10128
00000100:00080000:3.0:1786176394.109762:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176394.109769:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176394.109774:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe64700 x1872931145535104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176394.109779:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176394.109814:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145535104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176394.109815:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145535872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176394.109851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.109861:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176394.109870:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145535104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176394.109880:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145535232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176394.109941:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176394.109954:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe64380 x1872931145535232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176394.109968:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145535232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176394.109982:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.109985:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176394.109988:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145535232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176394.109996:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145535360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176394.110017:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176394.110029:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe65180 x1872931145535360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176394.110042:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145535360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176394.110051:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.110055:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176394.110059:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145535360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176394.110096:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145535488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176394.110122:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176394.110133:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe67b80 x1872931145535488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176394.110145:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145535488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176394.110159:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.110162:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176394.110165:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145535488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176394.110171:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145535616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176394.110189:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176394.110199:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe65f80 x1872931145535616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176394.110210:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145535616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176394.110217:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.110221:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176394.110224:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145535616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176394.110230:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145535744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176394.110249:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176394.110261:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe64000 x1872931145535744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176394.110272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145535744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176394.110281:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.110285:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176394.110289:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145535744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176394.110296:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145535872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176394.110336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176394.110348:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176394/real 1786176394]  req@ffff89d99fe66300 x1872931145535872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176394.110361:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145535872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176394.110370:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176394.110374:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176394.110378:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145535872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176394.621006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176394.621091:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176395.133109:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176395.645015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176395.645064:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176396.156969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176396.669029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176396.669108:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176397.181045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176397.693051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176397.693116:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176398.204950:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176398.716990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176398.717093:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176399.228989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176399.228998:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176399.229004:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176399.229007:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176399.229015:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00080000:0.0:1786176399.229024:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176399.229030:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176399.229063:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145536000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176399.229084:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176399.229087:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176399.229088:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176399.229091:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00080000:0.0:1786176399.229094:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176399.229097:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176399.229105:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176399.229114:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145536128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176399.229123:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176399.229127:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176399.229127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145536000:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176399.229129:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176399.229134:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00080000:0.0:1786176399.229140:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176399.229143:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176399.229146:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176399.229155:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145536256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176399.229167:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176399.229169:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176399.229171:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176399.229173:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00080000:0.0:1786176399.229182:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176399.229185:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176399.229188:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176399.229192:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176399.229197:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145536384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176399.229205:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176399.229208:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176399.229209:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176399.229213:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00080000:0.0:1786176399.229217:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176399.229220:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176399.229223:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176399.229231:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145536512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176399.229237:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176399.229240:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f1180 x1872931145536000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176399.229241:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176399.229243:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176399.229250:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00080000:0.0:1786176399.229255:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176399.229273:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176399.229278:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176399.229286:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145536000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176399.229289:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145536640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176399.229311:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176399.229316:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176399.229316:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176399.229321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176399.229324:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176399.229332:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00100000:1.0:1786176399.229333:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145536000:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176399.229341:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176399.229348:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176399.229354:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176399.229359:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145536128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176399.229366:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145536768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176399.229375:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176399.229378:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176399.229380:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176399.229383:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00080000:0.0:1786176399.229386:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176399.229387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176399.229392:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176399.229396:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176399.229402:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f0a80 x1872931145536128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176399.229407:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145536896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176399.229424:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145536128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176399.229431:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176399.229439:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176399.229442:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176399.229443:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176399.229446:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10133
00000100:00080000:0.0:1786176399.229450:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176399.229451:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176399.229456:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176399.229457:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145536128:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176399.229462:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176399.229466:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145536256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176399.229473:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145537024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176399.229485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176399.229496:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f3b80 x1872931145536256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176399.229505:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145536256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176399.229510:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176399.229513:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176399.229515:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145536256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176399.229518:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145536384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176399.229529:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176399.229534:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f3480 x1872931145536384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176399.229546:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145536384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176399.229551:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176399.229553:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176399.229554:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145536384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176399.229558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145536512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176399.229567:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176399.229573:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f0700 x1872931145536512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176399.229586:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145536512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176399.229592:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176399.229594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176399.229596:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145536512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176399.229599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145536640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176399.229610:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176399.229616:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f2d80 x1872931145536640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176399.229623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145536640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176399.229633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176399.229635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176399.229637:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145536640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176399.229651:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145536768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176399.229661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176399.229667:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f2a00 x1872931145536768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176399.229675:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145536768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176399.229683:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176399.229687:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176399.229690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145536768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176399.229696:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145536896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176399.229716:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176399.229729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f2680 x1872931145536896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176399.229741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145536896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176399.229747:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176399.229749:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176399.229751:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145536896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176399.229755:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145537024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176399.229769:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176399.229776:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176399/real 1786176399]  req@ffff89d9870f1880 x1872931145537024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176399.229783:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145537024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176399.229788:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176399.229790:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176399.229792:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145537024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176399.741028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176399.741096:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176400.252970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176400.764979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176400.765060:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176401.277002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176401.789022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176401.789092:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176402.301018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176402.812986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176402.813045:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176403.325023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176403.837028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176403.837135:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176404.349024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176404.349084:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349095:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176404.349099:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349111:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10138
00000100:00080000:0.0:1786176404.349123:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349133:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176404.349175:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145537152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176404.349224:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349231:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176404.349234:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349242:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10138
00000100:00080000:0.0:1786176404.349248:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349255:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176404.349264:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176404.349269:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145537152:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176404.349280:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145537280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176404.349295:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349298:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176404.349300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349308:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10138
00000100:00080000:0.0:1786176404.349312:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349317:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176404.349323:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176404.349341:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145537408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176404.349354:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349359:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176404.349361:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349365:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10138
00000100:00080000:0.0:1786176404.349370:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349374:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176404.349383:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176404.349403:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145537536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176404.349420:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349425:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176404.349428:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349440:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10138
00000800:00000100:3.0:1786176404.349445:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176404.349452:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349460:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176404.349467:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176404.349485:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145537664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176404.349499:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349503:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176404.349505:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349513:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10138
00000100:00080000:0.0:1786176404.349519:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349525:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176404.349531:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176404.349544:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145537792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176404.349554:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349558:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176404.349560:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349565:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10138
00000100:00080000:0.0:1786176404.349569:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349573:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176404.349580:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176404.349592:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145537920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176404.349605:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349609:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176404.349610:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349616:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10138
00000100:00080000:0.0:1786176404.349622:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349629:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176404.349635:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176404.349649:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145538048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176404.349664:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176404.349668:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176404.349671:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176404.349678:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10138
00000100:00080000:0.0:1786176404.349684:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176404.349693:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176404.349701:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176404.349707:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f0e00 x1872931145537152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176404.349717:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145538176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176404.349745:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145537152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.349762:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.349768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.349772:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145537152:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176404.349798:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145537280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176404.349820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176404.349830:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f1500 x1872931145537280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176404.349839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145537280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.349845:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.349848:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.349850:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145537280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176404.349854:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145537408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176404.349866:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176404.349873:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f3100 x1872931145537408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176404.349880:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145537408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.349886:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.349888:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.349889:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145537408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176404.349926:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145537536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176404.349945:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176404.349952:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f1880 x1872931145537536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176404.349960:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145537536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.349966:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.349968:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.349971:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145537536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176404.349974:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145537664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176404.349986:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176404.349992:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f2680 x1872931145537664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176404.350000:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145537664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.350004:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.350006:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.350008:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145537664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176404.350012:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145537792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176404.350022:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176404.350028:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f2a00 x1872931145537792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176404.350037:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145537792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.350042:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.350044:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.350045:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145537792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176404.350049:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145537920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176404.350059:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176404.350065:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f2d80 x1872931145537920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176404.350073:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145537920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.350078:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.350080:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.350081:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145537920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176404.350085:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145538048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176404.350095:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176404.350101:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f0700 x1872931145538048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176404.350107:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145538048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.350117:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.350119:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.350121:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145538048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176404.350125:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145538176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176404.350135:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176404.350141:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176404/real 1786176404]  req@ffff89d9870f3480 x1872931145538176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176404.350148:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145538176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176404.350154:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176404.350156:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176404.350157:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145538176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176404.860990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176404.861049:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176405.373001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176405.885052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176405.885231:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176406.397001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176406.908998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176406.909043:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176407.420977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176407.933000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176407.933067:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176408.444997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176408.956988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176408.957063:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176409.469027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176409.469027:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176409.469036:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176409.469040:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469048:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00080000:2.0:1786176409.469056:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176409.469064:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176409.469099:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145538304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176409.469121:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176409.469124:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176409.469125:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469128:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00080000:2.0:1786176409.469131:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176409.469133:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176409.469141:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176409.469151:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145538432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176409.469155:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145538304:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176409.469178:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176409.469184:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176409.469186:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469191:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00080000:2.0:1786176409.469194:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176409.469197:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176409.469202:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176409.469214:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145538560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176409.469221:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176409.469229:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176409.469231:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469234:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00080000:2.0:1786176409.469237:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1786176409.469241:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176409.469244:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176409.469249:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176409.469258:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145538688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176409.469265:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176409.469267:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176409.469269:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469271:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00080000:2.0:1786176409.469273:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176409.469276:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176409.469278:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176409.469287:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145538816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176409.469294:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87c700 x1872931145538304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176409.469296:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176409.469303:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176409.469306:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469314:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00080000:2.0:1786176409.469317:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176409.469321:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176409.469324:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176409.469327:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145538304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176409.469333:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145538944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176409.469346:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176409.469348:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176409.469352:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176409.469354:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176409.469355:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469363:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00100000:3.0:1786176409.469365:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145538304:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176409.469367:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176409.469373:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176409.469376:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176409.469383:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145539072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176409.469391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145538432:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176409.469392:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176409.469398:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176409.469399:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469403:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00080000:2.0:1786176409.469406:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176409.469409:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176409.469413:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176409.469420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176409.469424:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145539200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176409.469433:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176409.469437:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87d880 x1872931145538432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176409.469438:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176409.469441:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176409.469448:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10143
00000100:00100000:3.0:1786176409.469458:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145538432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176409.469459:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176409.469467:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176409.469471:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176409.469472:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176409.469479:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176409.469485:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145538432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176409.469486:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145539328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176409.469495:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145538560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176409.469513:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176409.469521:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87f800 x1872931145538560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176409.469538:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145538560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176409.469544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176409.469546:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176409.469555:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145538560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176409.469565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145538688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176409.469578:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176409.469585:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87ed80 x1872931145538688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176409.469593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145538688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176409.469599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176409.469601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176409.469603:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145538688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176409.469606:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145538816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176409.469616:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176409.469622:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87ca80 x1872931145538816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176409.469629:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145538816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176409.469633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176409.469635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176409.469637:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145538816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176409.469640:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145538944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176409.469650:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176409.469655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87dc00 x1872931145538944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176409.469663:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145538944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176409.469668:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176409.469670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176409.469672:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145538944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176409.469683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145539072:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176409.469694:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176409.469699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87e680 x1872931145539072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176409.469707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145539072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176409.469711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176409.469713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176409.469715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145539072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176409.469718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145539200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176409.469727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176409.469733:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87df80 x1872931145539200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176409.469740:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145539200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176409.469750:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176409.469752:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176409.469753:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145539200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176409.469757:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145539328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176409.469766:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176409.469771:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176409/real 1786176409]  req@ffff89d99e87c380 x1872931145539328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176409.469779:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145539328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176409.469784:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176409.469785:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176409.469787:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145539328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176409.980998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176409.981086:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176410.493031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176411.005025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176411.005081:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176411.516975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176412.028979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176412.029034:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176412.541025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176413.053016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176413.053085:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176413.564996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176414.077050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176414.077140:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176414.589039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176414.589056:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176414.589064:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176414.589070:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176414.589083:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589094:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176414.589103:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176414.589166:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145539456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176414.589199:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176414.589204:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176414.589206:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176414.589211:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589215:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176414.589219:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176414.589231:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176414.589245:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145539584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176414.589254:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145539456:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176414.589260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176414.589265:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176414.589268:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176414.589274:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589279:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176414.589283:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176414.589288:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176414.589302:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145539712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176414.589312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176414.589317:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176414.589319:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176414.589323:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589327:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176414.589330:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176414.589337:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176414.589337:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176414.589351:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145539840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176414.589362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176414.589367:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176414.589369:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176414.589374:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589377:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176414.589382:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176414.589387:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176414.589396:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2ff100 x1872931145539456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176414.589401:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145539968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176414.589418:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176414.589424:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786176414.589424:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145539456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176414.589428:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176414.589437:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589442:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176414.589442:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176414.589451:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176414.589452:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176414.589459:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145539456:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786176414.589460:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176414.589474:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145540096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176414.589487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176414.589489:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145539584:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176414.589495:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176414.589498:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176414.589504:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589510:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176414.589514:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786176414.589518:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786176414.589523:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176414.589531:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2ff800 x1872931145539584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176414.589539:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145540224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176414.589548:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145539584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176414.589557:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176414.589560:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176414.589562:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176414.589567:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176414.589567:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176414.589574:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145539584:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176414.589578:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589584:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176414.589585:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145539712:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176414.589591:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176414.589597:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176414.589605:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176414.589614:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145540352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176414.589617:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2fc380 x1872931145539712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176414.589643:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176414.589647:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176414.589651:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176414.589651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145539712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176414.589657:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10148
00000100:00080000:1.0:1786176414.589664:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176414.589671:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176414.589672:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786176414.589678:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176414.589681:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176414.589687:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145539712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176414.589693:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145540480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176414.589699:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145539840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176414.589731:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176414.589747:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2fd500 x1872931145539840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176414.589762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145539840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176414.589771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176414.589775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176414.589779:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145539840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176414.589784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145539968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176414.589800:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176414.589808:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2fea00 x1872931145539968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176414.589816:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145539968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176414.589822:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176414.589824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176414.589826:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145539968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176414.589840:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145540096:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176414.589852:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176414.589858:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2fed80 x1872931145540096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176414.589866:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145540096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176414.589872:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176414.589873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176414.589875:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145540096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176414.589879:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145540224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176414.589889:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176414.589915:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2fd180 x1872931145540224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176414.589925:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145540224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176414.589931:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176414.589933:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176414.589936:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145540224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176414.589940:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145540352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176414.589953:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176414.589960:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2ff100 x1872931145540352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176414.589967:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145540352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176414.589978:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176414.589980:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176414.589982:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145540352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176414.589986:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145540480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176414.590004:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176414.590011:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176414/real 1786176414]  req@ffff89d9ba2ffb80 x1872931145540480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176414.590019:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145540480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176414.590024:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176414.590027:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176414.590029:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145540480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176415.101014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176415.101125:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176415.612996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176416.124973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176416.125085:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176416.636984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176417.148985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176417.149081:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176417.660988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176418.173070:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176418.173110:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786176418.685001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176419.197003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176419.197056:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176419.708969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176419.709038:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176419.709051:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176419.709057:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176419.709087:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10153
00000100:00080000:1.0:1786176419.709120:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176419.709134:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176419.709202:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145540608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176419.709289:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176419.709296:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176419.709300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176419.709320:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10153
00000100:00080000:1.0:1786176419.709344:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176419.709347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145540608:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176419.709358:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176419.709376:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176419.709404:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145540736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176419.709416:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176419.709455:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176419.709461:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176419.709465:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176419.709469:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2fdf80 x1872931145540608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176419.709478:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10153
00000100:00080000:1.0:1786176419.709491:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176419.709493:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145540608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176419.709506:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176419.709515:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176419.709515:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176419.709540:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145540608:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786176419.709548:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176419.709576:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145540864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176419.709576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145540736:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176419.709608:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176419.709614:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176419.709617:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786176419.709622:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176419.709631:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10153
00000100:00080000:1.0:1786176419.709639:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176419.709645:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2fc700 x1872931145540736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176419.709651:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176419.709666:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176419.709689:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145540992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176419.709689:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145540736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176419.709773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176419.709776:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176419.709783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176419.709787:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176419.709796:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176419.709800:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145540736:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176419.709808:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10153
00000100:00080000:1.0:1786176419.709813:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176419.709823:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145540864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176419.709832:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176419.709840:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176419.709852:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176419.709854:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145541120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176419.709867:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2fce00 x1872931145540864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176419.709870:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176419.709888:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176419.709894:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176419.709925:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145540864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176419.709933:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176419.709938:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10153
00000100:00080000:3.0:1786176419.709939:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176419.709953:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176419.709958:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145540864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176419.709965:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176419.709972:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176419.709973:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145540992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176419.710001:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145541248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176419.710012:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176419.710019:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176419.710024:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176419.710027:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176419.710028:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2fd880 x1872931145540992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176419.710037:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10153
00000100:00080000:1.0:1786176419.710051:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176419.710058:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176419.710077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145540992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176419.710084:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176419.710087:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176419.710095:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176419.710098:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145540992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176419.710129:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145541376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176419.710136:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145541120:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786176419.710172:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176419.710176:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176419.710179:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176419.710189:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10153
00000800:00000100:3.0:1786176419.710192:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176419.710203:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176419.710212:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176419.710216:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2ff480 x1872931145541120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176419.710225:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176419.710244:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145541120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176419.710256:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176419.710260:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176419.710265:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145541504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176419.710270:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145541120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176419.710296:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145541248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176419.710302:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176419.710306:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176419.710309:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176419.710316:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10153
00000800:00000100:3.0:1786176419.710336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176419.710338:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176419.710346:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176419.710352:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2fdc00 x1872931145541248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176419.710353:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176419.710379:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145541632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176419.710380:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145541248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176419.710403:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176419.710420:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176419.710435:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145541248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176419.710453:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145541376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176419.710470:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176419.710477:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2fe300 x1872931145541376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176419.710485:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145541376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176419.710490:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176419.710492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176419.710494:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145541376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176419.710498:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145541504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176419.710509:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176419.710514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2fe680 x1872931145541504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176419.710522:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145541504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176419.710535:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176419.710538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176419.710542:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145541504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176419.710548:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145541632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176419.710568:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176419.710580:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176419/real 1786176419]  req@ffff89d9ba2fd880 x1872931145541632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176419.710592:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145541632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176419.710601:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176419.710604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176419.710607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145541632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176420.220966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176420.221029:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176420.732964:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176421.245024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176421.245216:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176421.756948:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176422.269008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176422.269053:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176422.780980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176423.293009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176423.293078:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176423.805048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176424.316973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176424.317079:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176424.828979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176424.829119:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176424.829130:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176424.829135:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176424.829146:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00080000:1.0:1786176424.829159:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829168:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176424.829228:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145541760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176424.829260:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176424.829264:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176424.829266:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176424.829270:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00080000:1.0:1786176424.829276:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829280:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176424.829290:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176424.829303:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145541888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176424.829314:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176424.829318:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176424.829321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176424.829325:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00080000:1.0:1786176424.829329:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829336:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176424.829344:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176424.829350:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145541760:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176424.829369:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145542016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176424.829390:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176424.829396:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176424.829399:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176424.829405:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00080000:1.0:1786176424.829414:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829420:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176424.829431:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176424.829443:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176424.829466:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145542144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176424.829487:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176424.829491:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176424.829494:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176424.829500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2fce00 x1872931145541760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176424.829501:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00080000:1.0:1786176424.829514:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829531:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176424.829542:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176424.829551:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145541760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176424.829565:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145542272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176424.829571:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176424.829582:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176424.829588:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145541760:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176424.829594:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176424.829601:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786176424.829601:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145541888:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176424.829610:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176424.829619:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00080000:1.0:1786176424.829624:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829629:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176424.829635:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176424.829636:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176424.829660:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145542400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176424.829673:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2fc700 x1872931145541888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176424.829680:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176424.829697:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176424.829701:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176424.829712:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00080000:1.0:1786176424.829718:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829729:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176424.829730:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145541888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176424.829735:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176424.829748:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145542528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176424.829755:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176424.829760:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176424.829766:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176424.829770:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176424.829773:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176424.829785:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00100000:3.0:1786176424.829786:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145541888:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176424.829797:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829804:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176424.829811:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176424.829824:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145542656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176424.829837:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176424.829840:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145542016:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176424.829849:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176424.829852:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176424.829861:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10159
00000100:00080000:1.0:1786176424.829868:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176424.829873:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176424.829881:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176424.829888:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176424.829960:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145542784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176424.829961:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2fdf80 x1872931145542016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176424.830051:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145542016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176424.830102:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176424.830110:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176424.830114:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145542016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176424.830122:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145542144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176424.830143:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176424.830152:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2ffb80 x1872931145542144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176424.830160:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145542144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176424.830165:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176424.830167:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176424.830169:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145542144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176424.830174:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145542272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176424.830185:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176424.830191:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2ff100 x1872931145542272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176424.830198:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145542272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176424.830203:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176424.830205:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176424.830206:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145542272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176424.830210:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145542400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176424.830221:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176424.830227:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2fd180 x1872931145542400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176424.830235:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145542400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176424.830241:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176424.830243:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176424.830244:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145542400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176424.830248:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145542528:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176424.830259:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176424.830265:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2fed80 x1872931145542528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176424.830272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145542528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176424.830278:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176424.830279:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176424.830281:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145542528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176424.830296:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145542656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176424.830307:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176424.830313:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2fea00 x1872931145542656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176424.830321:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145542656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176424.830332:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176424.830334:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176424.830336:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145542656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176424.830340:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145542784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176424.830351:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176424.830357:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176424/real 1786176424]  req@ffff89d9ba2fd500 x1872931145542784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176424.830364:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145542784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176424.830370:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176424.830372:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176424.830373:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145542784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176425.341035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176425.341086:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176425.853094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176426.365079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176426.365154:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176426.877083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176427.389016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176427.389093:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176427.901074:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176428.413032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176428.413085:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176428.925043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176429.437081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176429.437169:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176429.949058:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176429.949069:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176429.949075:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176429.949087:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00100000:2.0:1786176429.949094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176429.949101:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176429.949116:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176429.949166:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145542912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176429.949202:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176429.949207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176429.949209:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176429.949214:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00080000:0.0:1786176429.949219:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176429.949234:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176429.949245:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176429.949253:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145542912:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176429.949266:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145543040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176429.949280:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176429.949283:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176429.949286:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176429.949290:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00080000:0.0:1786176429.949295:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176429.949299:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176429.949304:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176429.949317:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145543168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176429.949327:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176429.949330:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176429.949332:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786176429.949338:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176429.949340:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00080000:0.0:1786176429.949346:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176429.949351:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176429.949356:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176429.949369:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145543296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176429.949378:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176429.949382:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176429.949383:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176429.949386:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00080000:0.0:1786176429.949391:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176429.949397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f3b80 x1872931145542912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176429.949398:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176429.949408:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176429.949427:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145543424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176429.949433:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145542912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176429.949446:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176429.949456:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176429.949459:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176429.949459:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176429.949472:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176429.949476:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00100000:3.0:1786176429.949483:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145542912:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176429.949487:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176429.949498:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176429.949507:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176429.949513:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145543040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176429.949531:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145543552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176429.949545:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176429.949562:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176429.949564:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f0a80 x1872931145543040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176429.949572:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176429.949578:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176429.949590:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00100000:3.0:1786176429.949595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145543040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176429.949598:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176429.949611:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176429.949613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176429.949619:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176429.949621:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176429.949630:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145543040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176429.949638:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145543168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176429.949644:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145543680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176429.949655:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176429.949658:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176429.949660:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176429.949663:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00080000:0.0:1786176429.949668:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176429.949672:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786176429.949678:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176429.949679:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176429.949697:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145543808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176429.949699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f1180 x1872931145543168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176429.949732:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176429.949737:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176429.949741:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176429.949745:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10164
00000100:00100000:3.0:1786176429.949746:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145543168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176429.949748:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176429.949759:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176429.949769:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176429.949773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176429.949781:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176429.949786:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145543936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176429.949791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145543168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176429.949809:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145543296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176429.949833:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176429.949846:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f3480 x1872931145543296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176429.949857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145543296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176429.949865:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176429.949868:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176429.949871:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145543296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176429.949876:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145543424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176429.949890:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176429.949924:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f0700 x1872931145543424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176429.949936:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145543424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176429.949943:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176429.949947:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176429.949949:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145543424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176429.949988:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145543552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176429.950008:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176429.950019:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f2d80 x1872931145543552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176429.950031:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145543552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176429.950040:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176429.950042:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176429.950045:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145543552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176429.950051:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145543680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176429.950065:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176429.950073:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f2a00 x1872931145543680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176429.950084:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145543680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176429.950091:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176429.950094:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176429.950097:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145543680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176429.950101:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145543808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176429.950114:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176429.950122:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f2680 x1872931145543808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176429.950132:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145543808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176429.950146:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176429.950148:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176429.950151:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145543808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176429.950156:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145543936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176429.950169:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176429.950177:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176429/real 1786176429]  req@ffff89d9870f1880 x1872931145543936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176429.950188:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145543936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176429.950196:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176429.950198:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176429.950201:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145543936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176430.461126:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176430.461205:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176430.973050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176431.485092:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176431.485202:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176431.997008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176432.509117:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176432.509225:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176433.021109:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176433.533029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176433.533150:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176434.045047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176434.557140:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176434.557216:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176435.069059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176435.069062:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069076:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176435.069082:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176435.069098:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.069113:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176435.069127:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176435.069185:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145544064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176435.069225:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069230:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176435.069233:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176435.069238:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.069250:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176435.069255:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176435.069266:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176435.069286:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145544192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176435.069299:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069303:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176435.069306:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176435.069310:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.069314:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176435.069321:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176435.069325:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145544064:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176435.069327:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176435.069347:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145544320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176435.069361:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069365:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176435.069367:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176435.069373:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.069378:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176435.069382:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176435.069389:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176435.069401:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145544448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176435.069413:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069416:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176435.069429:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176435.069435:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.069442:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176435.069449:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176435.069453:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176435.069456:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176435.069472:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145544576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176435.069485:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069490:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176435.069492:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176435.069496:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.069500:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176435.069505:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176435.069510:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176435.069529:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe66300 x1872931145544064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176435.069535:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145544704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176435.069586:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069594:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176435.069598:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145544064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176435.069615:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176435.069623:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176435.069626:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.069639:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176435.069643:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176435.069650:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176435.069660:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176435.069661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145544064:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176435.069681:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145544832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176435.069688:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145544192:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176435.069709:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069732:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176435.069737:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176435.069746:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.069754:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176435.069763:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176435.069774:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176435.069797:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176435.069820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe64000 x1872931145544192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176435.069827:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145544960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176435.069894:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176435.069902:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176435.069904:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145544192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176435.069906:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176435.069993:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10169
00000100:00080000:3.0:1786176435.070001:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176435.070007:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176435.070014:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176435.070037:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176435.070042:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145545088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176435.070051:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176435.070068:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145544192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176435.070114:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145544320:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176435.070155:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176435.070177:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe65f80 x1872931145544320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176435.070202:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145544320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176435.070218:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176435.070223:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176435.070231:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145544320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176435.070242:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145544448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176435.070279:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176435.070300:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe67b80 x1872931145544448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176435.070315:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145544448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176435.070325:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176435.070329:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176435.070333:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145544448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176435.070340:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145544576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176435.070362:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176435.070373:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe65180 x1872931145544576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176435.070386:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145544576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176435.070396:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176435.070400:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176435.070403:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145544576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176435.070410:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145544704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176435.070438:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176435.070458:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe64380 x1872931145544704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176435.070481:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145544704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176435.070496:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176435.070502:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176435.070508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145544704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176435.070519:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145544832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176435.070552:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176435.070568:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe64700 x1872931145544832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176435.070581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145544832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176435.070591:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176435.070594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176435.070598:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145544832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176435.070605:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145544960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176435.070625:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176435.070640:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe66680 x1872931145544960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176435.070662:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145544960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176435.070676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176435.070682:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176435.070688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145544960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176435.070697:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145545088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176435.070731:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176435.070751:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176435/real 1786176435]  req@ffff89d99fe64a80 x1872931145545088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176435.070771:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145545088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176435.070786:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176435.070791:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176435.070814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145545088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176435.581013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176435.581087:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176436.092989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176436.605036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176436.605095:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176437.116960:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176437.628986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176437.629032:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176438.140974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176438.652993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176438.653053:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176439.165016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176439.676998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176439.677087:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176440.189056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176440.189093:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176440.189101:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176440.189107:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176440.189121:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:0.0:1786176440.189135:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189147:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176440.189211:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145545216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176440.189247:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176440.189251:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176440.189253:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176440.189259:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:0.0:1786176440.189266:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189273:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176440.189305:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145545216:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176440.189311:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176440.189340:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145545344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176440.189358:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176440.189364:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176440.189369:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176440.189378:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:0.0:1786176440.189385:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189393:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176440.189400:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176440.189408:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176440.189419:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145545472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176440.189431:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176440.189435:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176440.189437:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176440.189441:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:0.0:1786176440.189445:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189449:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176440.189454:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176440.189464:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f3100 x1872931145545216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176440.189471:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145545600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176440.189491:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176440.189492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145545216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176440.189505:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176440.189511:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176440.189514:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176440.189521:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:3.0:1786176440.189522:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.189530:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145545216:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176440.189532:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189542:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176440.189549:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176440.189562:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145545728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176440.189572:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145545344:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176440.189586:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176440.189590:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176440.189592:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176440.189597:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:0.0:1786176440.189600:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189603:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176440.189608:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176440.189648:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145545856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176440.189662:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176440.189667:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176440.189670:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176440.189676:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:0.0:1786176440.189682:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189689:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176440.189698:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176440.189709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176440.189716:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145545984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176440.189728:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176440.189734:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1786176440.189734:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f1500 x1872931145545344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176440.189739:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176440.189750:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:0.0:1786176440.189758:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189767:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176440.189774:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176440.189792:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145546112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176440.189797:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145545344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176440.189811:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176440.189822:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176440.189825:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176440.189828:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176440.189831:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10174
00000100:00080000:0.0:1786176440.189837:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176440.189843:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176440.189847:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176440.189855:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145546240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176440.190050:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.190075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145545344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176440.190087:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145545472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176440.190171:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176440.190191:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f0e00 x1872931145545472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176440.190206:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145545472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176440.190214:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176440.190218:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.190221:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145545472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176440.190226:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145545600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176440.190245:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176440.190253:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f1880 x1872931145545600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176440.190263:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145545600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176440.190285:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176440.190288:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.190291:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145545600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176440.190305:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145545728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176440.190318:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176440.190326:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f2680 x1872931145545728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176440.190335:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145545728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176440.190342:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176440.190345:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.190348:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145545728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176440.190353:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145545856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176440.190365:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176440.190373:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f2a00 x1872931145545856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176440.190382:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145545856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176440.190388:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176440.190391:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.190394:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145545856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176440.190399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145545984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176440.190411:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176440.190418:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f2d80 x1872931145545984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176440.190428:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145545984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176440.190434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176440.190436:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.190439:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145545984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176440.190443:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145546112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176440.190456:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176440.190463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f0700 x1872931145546112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176440.190471:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145546112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176440.190477:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176440.190480:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.190482:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145546112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176440.190486:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145546240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176440.190497:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176440.190504:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176440/real 1786176440]  req@ffff89d9870f3480 x1872931145546240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176440.190514:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145546240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176440.190520:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176440.190522:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176440.190525:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145546240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176440.700965:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176440.701049:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176441.212970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176441.724993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176441.725108:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176442.236989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176442.749042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176442.749109:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176443.261028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176443.772990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176443.773043:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176444.284997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176444.797006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176444.797087:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176445.309018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176445.309036:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176445.309042:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176445.309045:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309056:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:3.0:1786176445.309065:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176445.309073:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176445.309105:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145546368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176445.309133:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176445.309136:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176445.309137:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309140:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:3.0:1786176445.309142:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176445.309145:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176445.309153:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176445.309161:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145546496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176445.309167:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176445.309169:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176445.309170:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309172:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:3.0:1786176445.309174:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176445.309176:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176445.309179:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176445.309185:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145546624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176445.309191:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176445.309193:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176445.309194:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309197:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:3.0:1786176445.309199:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176445.309202:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176445.309204:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176445.309210:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145546752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176445.309216:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176445.309222:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145546368:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176445.309222:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176445.309225:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309233:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:3.0:1786176445.309235:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176445.309237:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176445.309240:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176445.309247:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145546880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176445.309253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176445.309256:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176445.309258:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309260:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:3.0:1786176445.309263:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176445.309266:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176445.309268:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176445.309275:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145547008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176445.309280:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176445.309284:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000800:00000100:1.0:1786176445.309285:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176445.309286:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309292:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:3.0:1786176445.309295:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176445.309297:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176445.309301:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176445.309319:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145547136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176445.309324:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176445.309326:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176445.309327:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309330:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:3.0:1786176445.309333:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176445.309339:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe67800 x1872931145546368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176445.309339:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176445.309342:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176445.309354:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145547264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176445.309360:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145546368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176445.309365:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176445.309373:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176445.309375:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176445.309388:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10179
00000100:00080000:1.0:1786176445.309390:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176445.309391:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176445.309397:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176445.309398:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176445.309403:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176445.309405:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145546368:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176445.309413:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145547392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176445.309423:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145546496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176445.309442:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176445.309451:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe67480 x1872931145546496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176445.309459:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145546496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176445.309465:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176445.309467:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176445.309469:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145546496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176445.309473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145546624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176445.309482:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176445.309488:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe65880 x1872931145546624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176445.309500:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145546624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176445.309505:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176445.309507:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176445.309509:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145546624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176445.309526:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145546752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176445.309537:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176445.309543:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe67100 x1872931145546752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176445.309550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145546752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176445.309555:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176445.309557:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176445.309558:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145546752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176445.309562:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145546880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176445.309571:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176445.309576:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe66d80 x1872931145546880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176445.309583:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145546880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176445.309592:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176445.309594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176445.309596:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145546880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176445.309600:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145547008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176445.309608:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176445.309614:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe66a00 x1872931145547008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176445.309621:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145547008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176445.309626:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176445.309628:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176445.309629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145547008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176445.309632:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145547136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176445.309642:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176445.309647:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe65500 x1872931145547136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176445.309665:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145547136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176445.309670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176445.309671:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176445.309674:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145547136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176445.309677:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145547264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176445.309687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176445.309692:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe64a80 x1872931145547264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176445.309699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145547264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176445.309704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176445.309706:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176445.309708:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145547264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176445.309711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145547392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176445.309720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176445.309725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176445/real 1786176445]  req@ffff89d99fe66680 x1872931145547392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176445.309744:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145547392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176445.309750:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176445.309752:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176445.309754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145547392:192.168.202.130@tcp:8:kworker.0
00010000:00010000:0.0:1786176445.821039:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176445.821042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786176446.332986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176446.845049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176446.845161:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176447.357003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176447.868974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176447.869019:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176448.380977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176448.893000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176448.893059:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176449.404982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176449.916996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176449.917063:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176450.428987:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176450.428991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176450.428998:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176450.429002:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176450.429011:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429019:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176450.429037:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176450.429070:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145547520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176450.429092:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176450.429095:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176450.429097:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176450.429099:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429101:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176450.429104:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176450.429111:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176450.429120:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145547648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176450.429128:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176450.429131:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176450.429133:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176450.429135:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145547520:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176450.429139:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429147:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176450.429154:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176450.429160:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176450.429174:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145547776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176450.429193:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176450.429197:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176450.429198:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176450.429201:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429204:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176450.429210:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176450.429211:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176450.429215:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176450.429228:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145547904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176450.429235:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176450.429238:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176450.429239:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176450.429241:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429243:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176450.429246:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176450.429249:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176450.429258:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145548032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176450.429263:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe64700 x1872931145547520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176450.429267:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176450.429274:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176450.429278:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176450.429284:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429289:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176450.429292:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176450.429304:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176450.429314:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145548160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176450.429315:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145547520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176450.429330:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176450.429339:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176450.429340:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176450.429343:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176450.429344:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429349:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176450.429355:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176450.429355:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176450.429360:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176450.429365:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145547520:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176450.429370:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145548288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176450.429377:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176450.429379:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176450.429381:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176450.429384:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429386:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176450.429389:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176450.429393:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176450.429398:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145547648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176450.429402:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145548416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176450.429410:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176450.429412:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176450.429416:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176450.429418:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10184
00000100:00080000:3.0:1786176450.429420:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176450.429422:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176450.429425:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176450.429432:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145548544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176450.429447:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176450.429465:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe64380 x1872931145547648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176450.429479:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145547648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176450.429489:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176450.429493:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176450.429497:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145547648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176450.429504:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145547776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176450.429524:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176450.429539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe65180 x1872931145547776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176450.429552:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145547776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176450.429566:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176450.429570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176450.429573:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145547776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176450.429579:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145547904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176450.429618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176450.429630:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe67b80 x1872931145547904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176450.429642:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145547904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176450.429651:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176450.429654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176450.429657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145547904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176450.429664:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145548032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176450.429685:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176450.429698:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe65f80 x1872931145548032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176450.429711:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145548032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176450.429718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176450.429721:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176450.429725:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145548032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176450.429732:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145548160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176450.429752:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176450.429765:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe64000 x1872931145548160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176450.429821:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145548160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176450.429839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176450.429842:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176450.429846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145548160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176450.429852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145548288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176450.429873:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176450.429886:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe66300 x1872931145548288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176450.429920:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145548288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176450.429928:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176450.429931:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176450.429934:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145548288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176450.429957:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145548416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176450.429977:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176450.429991:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe64700 x1872931145548416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176450.430003:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145548416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176450.430012:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176450.430016:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176450.430019:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145548416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176450.430025:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145548544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176450.430043:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176450.430062:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176450/real 1786176450]  req@ffff89d99fe66680 x1872931145548544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176450.430074:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145548544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176450.430083:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176450.430087:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176450.430090:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145548544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176450.941027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176450.941087:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176451.452970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176451.964982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176451.965089:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176452.476976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176452.988993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176452.989047:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176453.501014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176454.013014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176454.013091:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176454.524975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176455.037012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176455.037084:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176455.549017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176455.549034:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549042:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176455.549047:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176455.549057:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00080000:1.0:1786176455.549067:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176455.549075:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176455.549111:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145548672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176455.549148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549157:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176455.549159:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176455.549165:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00080000:1.0:1786176455.549169:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176455.549174:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145548672:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176455.549178:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176455.549190:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176455.549206:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145548800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176455.549218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549221:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176455.549223:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176455.549227:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00080000:1.0:1786176455.549240:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176455.549245:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176455.549250:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176455.549267:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145548928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176455.549278:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145548800:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176455.549279:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549287:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176455.549290:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176455.549296:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00080000:1.0:1786176455.549301:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176455.549305:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176455.549313:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176455.549313:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145548928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176455.549332:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145549056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176455.549347:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549351:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176455.549354:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176455.549359:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00080000:1.0:1786176455.549364:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176455.549368:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145549056:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786176455.549372:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176455.549379:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176455.549395:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145549184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176455.549408:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549412:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176455.549414:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176455.549419:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00100000:3.0:1786176455.549424:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145549184:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786176455.549426:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176455.549435:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176455.549441:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176455.549456:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145549312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176455.549476:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549480:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176455.549482:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176455.549487:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145549312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176455.549489:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00080000:1.0:1786176455.549496:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176455.549503:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176455.549509:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176455.549525:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145549440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176455.549538:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549542:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176455.549544:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176455.549550:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00080000:1.0:1786176455.549555:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176455.549558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145549440:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176455.549563:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176455.549571:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176455.549586:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145549568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176455.549604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176455.549608:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176455.549611:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176455.549615:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10189
00000100:00080000:1.0:1786176455.549620:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176455.549624:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176455.549629:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145549568:192.168.202.130@tcp:8:kworker.0
00000008:00100000:1.0:1786176455.549631:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176455.549648:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145549696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176455.549673:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145549696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176456.061018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176456.061073:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176456.573029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176457.085009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176457.085075:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176457.597071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176458.109015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176458.109064:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176458.621108:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:1.0:1786176458.621219:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:1.0:1786176458.621265:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1786176458.621281:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786176458.621322:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:1.0:1786176458.621337:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176458.621345:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2fc380 x1872931145548672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786176458.621352:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786176458.621365:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786176458.621379:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176458.621384:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145548672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786176458.621393:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786176458.621405:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000800:00000100:1.0:1786176458.621409:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786176458.621414:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621422:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145548672:192.168.202.130@tcp:250:kworker.0
00000800:00000100:1.0:1786176458.621423:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176458.621451:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2fdf80 x1872931145549696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176458.621467:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145549696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176458.621477:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176458.621481:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621485:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145549696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176458.621492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2ffb80 x1872931145549568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176458.621502:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145549568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176458.621509:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176458.621512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621516:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145549568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176458.621522:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2ff100 x1872931145549440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176458.621533:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145549440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176458.621540:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176458.621543:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621546:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145549440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176458.621552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2fd180 x1872931145549312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176458.621563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145549312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176458.621570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176458.621574:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621577:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145549312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176458.621583:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2fed80 x1872931145549184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176458.621594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145549184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176458.621600:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176458.621603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145549184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176458.621612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2fea00 x1872931145549056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176458.621623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145549056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176458.621630:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176458.621634:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145549056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176458.621644:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2fd500 x1872931145548928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176458.621655:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145548928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176458.621663:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176458.621666:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145548928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176458.621675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176455/real 1786176458]  req@ffff89d9ba2ff800 x1872931145548800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176458.621685:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145548800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176458.621736:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176458.621740:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176458.621744:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145548800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176459.132990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176459.133089:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176459.645058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176460.156991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176460.157036:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176460.669006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176460.669041:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176460.669047:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176460.669051:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669059:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00080000:3.0:1786176460.669069:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176460.669077:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176460.669109:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145549824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176460.669133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176460.669136:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176460.669137:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669140:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00080000:3.0:1786176460.669143:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176460.669146:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176460.669170:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176460.669180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145549824:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176460.669184:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145549952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176460.669198:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176460.669202:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176460.669204:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669209:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00080000:3.0:1786176460.669213:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176460.669217:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176460.669222:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176460.669235:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145550080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176460.669243:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176460.669251:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176460.669256:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176460.669258:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669263:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00080000:3.0:1786176460.669268:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176460.669272:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176460.669278:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176460.669282:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe64a80 x1872931145549824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176460.669291:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145550208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176460.669307:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176460.669310:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145549824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176460.669311:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176460.669315:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669325:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00080000:3.0:1786176460.669330:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176460.669332:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176460.669333:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176460.669342:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176460.669345:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176460.669352:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145549824:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176460.669357:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145550336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176460.669368:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176460.669371:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176460.669373:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669377:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00100000:1.0:1786176460.669381:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145549952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176460.669383:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176460.669392:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176460.669398:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176460.669412:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145550464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176460.669420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176460.669430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176460.669434:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176460.669435:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669442:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00100000:1.0:1786176460.669444:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe65500 x1872931145549952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176460.669448:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176460.669457:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176460.669465:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176460.669468:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145549952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176460.669480:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145550592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176460.669481:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176460.669491:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176460.669497:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145549952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176460.669508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176460.669509:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145550080:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176460.669518:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176460.669521:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669527:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00080000:3.0:1786176460.669531:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176460.669536:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176460.669541:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176460.669543:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176460.669559:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145550720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176460.669561:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe66a00 x1872931145550080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176460.669587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176460.669594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145550080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176460.669594:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176460.669597:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176460.669606:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10194
00000100:00080000:3.0:1786176460.669615:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176460.669616:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176460.669622:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176460.669625:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176460.669630:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176460.669633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145550080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176460.669643:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145550208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176460.669647:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145550848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176460.669690:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176460.669705:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe66d80 x1872931145550208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176460.669720:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145550208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176460.669730:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176460.669733:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176460.669737:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145550208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176460.669744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145550336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176460.669765:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176460.669778:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe67100 x1872931145550336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176460.669790:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145550336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176460.669799:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176460.669802:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176460.669805:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145550336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176460.669828:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145550464:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176460.669857:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176460.669872:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe65880 x1872931145550464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176460.669892:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145550464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176460.669923:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176460.669927:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176460.669931:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145550464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176460.669938:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145550592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176460.669959:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176460.669971:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe67480 x1872931145550592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176460.669983:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145550592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176460.669990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176460.669993:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176460.669996:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145550592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176460.670002:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145550720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176460.670022:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176460.670032:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe67800 x1872931145550720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176460.670043:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145550720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176460.670057:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176460.670060:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176460.670063:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145550720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176460.670070:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145550848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176460.670088:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176460.670100:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176460/real 1786176460]  req@ffff89d99fe64a80 x1872931145550848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176460.670111:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145550848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176460.670119:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176460.670122:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176460.670124:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145550848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176461.180994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176461.181055:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176461.693010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176462.205026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176462.205140:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176462.717047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176463.229015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176463.229072:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176463.740995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176464.252982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176464.253043:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176464.765077:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176465.276998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176465.277056:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176465.788983:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176465.788989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176465.788995:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176465.789001:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176465.789011:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789021:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176465.789029:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176465.789099:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145550976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176465.789126:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176465.789129:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176465.789131:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176465.789134:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789138:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176465.789141:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176465.789152:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176465.789164:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145551104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176465.789172:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145550976:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176465.789175:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176465.789181:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176465.789184:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176465.789188:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789190:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176465.789192:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176465.789197:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176465.789207:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145551232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176465.789214:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176465.789217:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176465.789218:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176465.789220:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789222:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176465.789225:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176465.789228:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176465.789236:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145551360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176465.789242:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176465.789245:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176465.789246:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176465.789249:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789252:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176465.789254:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176465.789257:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176465.789267:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145551488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176465.789269:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176465.789277:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176465.789279:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176465.789281:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176465.789285:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789288:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176465.789291:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176465.789295:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176465.789301:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145551616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176465.789308:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176465.789311:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176465.789312:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176465.789315:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789317:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176465.789320:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176465.789323:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176465.789328:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe66680 x1872931145550976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176465.789333:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145551744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176465.789352:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176465.789354:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176465.789355:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176465.789360:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145550976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176465.789360:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789362:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176465.789370:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176465.789377:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176465.789381:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176465.789387:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145551872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176465.789389:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789398:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145550976:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176465.789400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176465.789407:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176465.789408:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176465.789412:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10200
00000100:00080000:3.0:1786176465.789421:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176465.789429:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145551104:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176465.789430:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176465.789438:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176465.789453:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145552000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176465.789460:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176465.789473:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe64700 x1872931145551104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176465.789483:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145551104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176465.789490:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176465.789492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789495:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145551104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176465.789499:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145551232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176465.789511:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176465.789517:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe66300 x1872931145551232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176465.789525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145551232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176465.789530:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176465.789532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789534:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145551232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176465.789538:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145551360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176465.789549:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176465.789555:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe64000 x1872931145551360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176465.789563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145551360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176465.789569:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176465.789571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789572:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145551360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176465.789576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145551488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176465.789585:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176465.789590:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe65f80 x1872931145551488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176465.789597:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145551488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176465.789602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176465.789604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145551488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176465.789609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145551616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176465.789637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176465.789649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe67b80 x1872931145551616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176465.789660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145551616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176465.789676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176465.789679:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789682:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145551616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176465.789687:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145551744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176465.789711:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176465.789719:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe65180 x1872931145551744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176465.789727:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145551744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176465.789733:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176465.789735:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789737:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145551744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176465.789741:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145551872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176465.789751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176465.789757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe64380 x1872931145551872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176465.789764:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145551872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176465.789769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176465.789771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145551872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176465.789792:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145552000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176465.789802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176465.789809:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176465/real 1786176465]  req@ffff89d99fe66680 x1872931145552000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176465.789816:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145552000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176465.789822:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176465.789824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176465.789826:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145552000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176466.301023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176466.301110:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176466.812989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176467.324979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176467.325002:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176467.837006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176468.349006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176468.349067:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176468.861008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176469.373033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176469.373103:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176469.885015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176470.397010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176470.397111:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176470.909010:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176470.909021:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176470.909027:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176470.909027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176470.909040:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00080000:0.0:1786176470.909052:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909066:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176470.909104:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145552128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176470.909131:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176470.909135:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176470.909137:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176470.909141:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00080000:0.0:1786176470.909145:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909150:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176470.909160:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176470.909170:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145552128:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176470.909176:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145552256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176470.909190:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176470.909194:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176470.909196:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176470.909200:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00080000:0.0:1786176470.909204:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909208:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176470.909212:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176470.909223:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145552384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176470.909234:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176470.909241:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176470.909242:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176470.909246:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176470.909251:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00080000:0.0:1786176470.909256:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909260:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176470.909266:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176470.909278:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145552512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176470.909288:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176470.909292:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f1180 x1872931145552128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176470.909293:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176470.909297:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176470.909306:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00080000:0.0:1786176470.909312:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909317:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176470.909322:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176470.909324:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145552128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176470.909336:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145552640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176470.909340:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.909352:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176470.909353:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176470.909359:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176470.909361:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145552128:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176470.909362:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176470.909369:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00080000:0.0:1786176470.909372:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909375:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176470.909383:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176470.909394:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145552768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176470.909404:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145552256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176470.909407:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176470.909413:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176470.909416:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176470.909421:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00080000:0.0:1786176470.909425:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909430:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176470.909435:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176470.909437:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176470.909450:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145552896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176470.909459:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f0a80 x1872931145552256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176470.909464:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176470.909472:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176470.909475:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176470.909483:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00100000:1.0:1786176470.909488:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145552256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176470.909490:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909499:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176470.909507:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176470.909510:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.909517:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176470.909521:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145553024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176470.909525:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145552256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176470.909541:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176470.909542:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145552384:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176470.909550:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176470.909554:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176470.909560:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10205
00000100:00080000:0.0:1786176470.909583:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176470.909599:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176470.909605:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176470.909608:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176470.909622:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145553152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176470.909625:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f3b80 x1872931145552384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176470.909658:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145552384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176470.909667:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.909672:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176470.909675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145552384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176470.909683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145552512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176470.909703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176470.909714:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f3480 x1872931145552512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176470.909725:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145552512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176470.909734:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.909738:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176470.909741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145552512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176470.909747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145552640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176470.909767:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176470.909779:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f0700 x1872931145552640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176470.909792:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145552640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176470.909801:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.909804:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176470.909807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145552640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176470.909829:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145552768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176470.909850:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176470.909862:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f2d80 x1872931145552768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176470.909875:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145552768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176470.909883:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.909886:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176470.909890:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145552768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176470.909916:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145552896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176470.909936:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176470.909948:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f2a00 x1872931145552896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176470.909961:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145552896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176470.909970:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.909973:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176470.909977:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145552896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176470.909984:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145553024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176470.910003:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176470.910014:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f2680 x1872931145553024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176470.910026:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145553024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176470.910035:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.910038:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176470.910041:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145553024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176470.910048:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145553152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176470.910068:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176470.910079:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176470/real 1786176470]  req@ffff89d9870f1880 x1872931145553152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176470.910091:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145553152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176470.910100:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176470.910103:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176470.910107:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145553152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176471.420985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176471.421089:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176471.932965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176472.444970:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176472.445039:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176472.957007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176473.469042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176473.469111:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176473.980974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176474.493064:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176474.493124:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176475.005007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176475.517050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176475.517118:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176476.029003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176476.029052:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176476.029064:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176476.029069:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176476.029082:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029095:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176476.029104:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176476.029152:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145553280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176476.029179:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176476.029183:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176476.029185:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176476.029191:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029194:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176476.029200:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176476.029208:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145553280:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176476.029216:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176476.029232:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145553408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176476.029243:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176476.029248:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176476.029251:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176476.029256:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029272:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176476.029278:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176476.029285:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176476.029285:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176476.029306:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145553536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176476.029315:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176476.029318:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176476.029320:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176476.029323:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029327:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176476.029333:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176476.029338:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176476.029345:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f0e00 x1872931145553280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176476.029353:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145553664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176476.029399:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176476.029404:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176476.029405:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176476.029410:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029413:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176476.029417:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145553280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176476.029419:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176476.029428:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176476.029442:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145553792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176476.029445:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176476.029450:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176476.029455:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176476.029457:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176476.029460:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176476.029466:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029473:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176476.029478:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145553280:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176476.029486:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176476.029497:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176476.029517:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145553920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176476.029518:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145553408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176476.029563:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176476.029569:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176476.029572:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176476.029579:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029587:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176476.029595:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176476.029609:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176476.029618:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176476.029621:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f1500 x1872931145553408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176476.029641:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145554048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176476.029642:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145553408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176476.029702:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176476.029706:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176476.029707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176476.029715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145553408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176476.029718:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176476.029724:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176476.029725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145553536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176476.029740:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029746:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176476.029750:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176476.029756:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176476.029757:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176476.029770:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f3100 x1872931145553536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176476.029776:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145554176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176476.029815:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145553536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176476.029825:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176476.029828:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176476.029837:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176476.029839:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176476.029843:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145553536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176476.029846:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176476.029854:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145553664:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176476.029861:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10210
00000100:00080000:0.0:1786176476.029870:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176476.029879:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176476.029880:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176476.029890:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f1880 x1872931145553664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176476.029891:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176476.029935:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145553664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176476.029947:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176476.029958:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176476.029959:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145554304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176476.029972:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145553664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176476.029992:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145553792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176476.030016:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176476.030029:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f2680 x1872931145553792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176476.030039:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145553792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176476.030044:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176476.030047:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176476.030049:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145553792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176476.030065:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145553920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176476.030076:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176476.030082:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f2a00 x1872931145553920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176476.030089:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145553920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176476.030094:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176476.030096:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176476.030098:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145553920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176476.030102:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145554048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176476.030112:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176476.030118:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f2d80 x1872931145554048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176476.030126:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145554048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176476.030131:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176476.030132:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176476.030134:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145554048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176476.030138:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145554176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176476.030156:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176476.030167:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f0700 x1872931145554176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176476.030179:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145554176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176476.030188:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176476.030191:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176476.030195:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145554176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176476.030202:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145554304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176476.030223:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176476.030235:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176476/real 1786176476]  req@ffff89d9870f3480 x1872931145554304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176476.030245:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145554304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176476.030251:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176476.030254:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176476.030256:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145554304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176476.541009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176476.541077:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176477.053048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176477.565016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176477.565072:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176478.077007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176478.588998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176478.589114:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176479.101010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176479.613005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176479.613073:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176480.125018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176480.637022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176480.637085:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176481.149020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176481.149024:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176481.149036:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176481.149042:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176481.149055:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00080000:2.0:1786176481.149068:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176481.149077:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176481.149129:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145554432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176481.149161:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176481.149166:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176481.149168:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176481.149174:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00080000:2.0:1786176481.149180:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176481.149185:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176481.149193:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145554432:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176481.149198:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176481.149214:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145554560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176481.149227:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176481.149231:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176481.149234:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176481.149239:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00080000:2.0:1786176481.149244:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176481.149248:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176481.149254:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176481.149269:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145554688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176481.149270:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176481.149283:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176481.149288:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176481.149290:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176481.149295:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00080000:2.0:1786176481.149299:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176481.149303:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176481.149310:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176481.149320:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87d500 x1872931145554432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176481.149327:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145554816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176481.149340:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145554432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176481.149361:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176481.149363:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176481.149368:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176481.149370:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176481.149373:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176481.149377:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145554432:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176481.149382:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00080000:2.0:1786176481.149388:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176481.149393:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176481.149399:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176481.149404:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145554560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176481.149417:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145554944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176481.149427:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176481.149434:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176481.149439:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176481.149441:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87c000 x1872931145554560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176481.149442:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176481.149452:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00100000:1.0:1786176481.149456:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145554560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176481.149459:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176481.149484:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176481.149489:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176481.149492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145554560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176481.149497:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145554688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176481.149500:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176481.149509:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176481.149516:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176481.149525:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145555072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176481.149529:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87f100 x1872931145554688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176481.149558:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176481.149559:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145554688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176481.149568:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176481.149573:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176481.149582:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176481.149583:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00080000:2.0:1786176481.149591:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176481.149592:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176481.149600:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176481.149602:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145554688:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176481.149607:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176481.149620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145554816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176481.149625:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145555200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176481.149638:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176481.149642:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786176481.149646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176481.149646:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176481.149655:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00100000:1.0:1786176481.149660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87c380 x1872931145554816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176481.149661:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176481.149670:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176481.149677:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176481.149678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145554816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176481.149688:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176481.149691:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176481.149696:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145555328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176481.149697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145554816:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176481.149714:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176481.149717:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176481.149718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145554944:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176481.149721:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176481.149730:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10215
00000100:00080000:2.0:1786176481.149735:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176481.149739:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176481.149743:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176481.149750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87df80 x1872931145554944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176481.149750:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176481.149763:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145554944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176481.149769:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145555456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176481.149771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176481.149778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176481.149784:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145554944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176481.149794:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145555072:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176481.149815:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176481.149823:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87e680 x1872931145555072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176481.149833:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145555072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176481.149838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176481.149839:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176481.149841:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145555072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176481.149845:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145555200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176481.149855:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176481.149860:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87dc00 x1872931145555200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176481.149868:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145555200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176481.149878:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176481.149879:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176481.149881:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145555200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176481.149884:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145555328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176481.149895:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176481.149930:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87ca80 x1872931145555328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176481.149938:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145555328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176481.149944:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176481.149946:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176481.149948:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145555328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176481.149961:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145555456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176481.149974:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176481.149980:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176481/real 1786176481]  req@ffff89d99e87ed80 x1872931145555456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176481.149988:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145555456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176481.149993:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176481.149995:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176481.149998:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145555456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176481.660995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176481.661070:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176482.173042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176482.685038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176482.685103:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176483.196966:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176483.709008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176483.709071:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176484.220986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176484.733051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176484.733084:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176485.245018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176485.757052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176485.757128:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176486.268993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176486.269017:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269023:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176486.269026:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176486.269050:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269059:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176486.269066:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176486.269097:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145555584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176486.269122:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269125:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176486.269127:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176486.269129:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269132:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176486.269134:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176486.269142:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176486.269168:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145555712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176486.269176:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269178:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176486.269180:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176486.269183:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269185:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176486.269188:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176486.269193:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176486.269204:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145555840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176486.269211:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269214:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176486.269215:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176486.269218:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269219:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176486.269222:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176486.269226:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176486.269234:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145555584:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176486.269239:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145555968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176486.269275:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269277:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176486.269278:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176486.269284:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269287:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176486.269290:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176486.269294:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176486.269310:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145556096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176486.269316:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269318:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176486.269321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176486.269324:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269327:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176486.269330:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176486.269335:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176486.269344:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176486.269350:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145556224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176486.269357:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269361:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176486.269363:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176486.269368:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269371:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176486.269373:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176486.269377:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176486.269386:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145556352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176486.269392:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269395:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176486.269396:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176486.269400:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87f800 x1872931145555584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176486.269403:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269411:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176486.269435:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176486.269439:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176486.269452:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145556480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176486.269456:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145555584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176486.269505:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176486.269509:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176486.269512:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176486.269512:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176486.269529:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176486.269530:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10220
00000100:00080000:2.0:1786176486.269544:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176486.269547:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145555584:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176486.269556:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176486.269564:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176486.269566:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145555712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176486.269579:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145556608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176486.269600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176486.269616:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87d880 x1872931145555712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176486.269625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145555712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176486.269632:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176486.269635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176486.269638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145555712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176486.269643:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145555840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176486.269655:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176486.269662:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87c700 x1872931145555840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176486.269670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145555840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176486.269676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176486.269678:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176486.269680:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145555840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176486.269708:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145555968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176486.269720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176486.269727:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87ed80 x1872931145555968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176486.269735:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145555968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176486.269740:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176486.269742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176486.269743:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145555968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176486.269747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145556096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176486.269757:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176486.269763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87ca80 x1872931145556096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176486.269770:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145556096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176486.269776:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176486.269778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176486.269780:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145556096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176486.269784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145556224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176486.269793:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176486.269799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87dc00 x1872931145556224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176486.269807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145556224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176486.269812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176486.269814:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176486.269816:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145556224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176486.269819:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145556352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176486.269840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176486.269859:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87e680 x1872931145556352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176486.269871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145556352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176486.269880:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176486.269884:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176486.269888:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145556352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176486.269942:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145556480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176486.269960:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176486.269979:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87df80 x1872931145556480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176486.269987:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145556480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176486.269994:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176486.269996:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176486.269998:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145556480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176486.270002:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145556608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176486.270013:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176486.270018:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176486/real 1786176486]  req@ffff89d99e87c380 x1872931145556608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176486.270026:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145556608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176486.270031:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176486.270033:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176486.270035:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145556608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176486.780974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176486.781059:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176487.292948:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176487.805034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176487.805075:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176488.316973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176488.829094:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176488.829190:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176489.341004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176489.853038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176489.853113:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176490.364973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176490.877008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176490.877074:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176491.388989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176491.388990:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389016:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176491.389020:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176491.389029:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00080000:0.0:1786176491.389037:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176491.389044:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176491.389087:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145556736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176491.389109:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389119:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176491.389121:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176491.389124:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00080000:0.0:1786176491.389128:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176491.389131:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176491.389139:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176491.389161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145556736:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176491.389168:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145556864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176491.389178:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389180:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176491.389182:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176491.389185:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00080000:0.0:1786176491.389188:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176491.389191:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176491.389195:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176491.389203:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145556992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176491.389227:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389229:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176491.389231:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176491.389233:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00080000:0.0:1786176491.389236:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176491.389239:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176491.389243:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176491.389248:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176491.389266:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145557120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176491.389280:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389284:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176491.389289:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176491.389289:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f3b80 x1872931145556736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176491.389301:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00100000:1.0:1786176491.389312:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145556736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176491.389316:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176491.389329:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176491.389331:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176491.389336:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786176491.389340:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176491.389341:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145556736:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176491.389359:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145557248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176491.389368:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145556864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176491.389382:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389389:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176491.389391:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176491.389395:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00080000:0.0:1786176491.389398:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176491.389403:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176491.389408:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176491.389412:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176491.389423:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145557376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176491.389429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f0a80 x1872931145556864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176491.389437:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389444:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176491.389446:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145556864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176491.389448:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176491.389459:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00080000:1.0:1786176491.389461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176491.389467:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176491.389467:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176491.389474:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145556864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176491.389478:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176491.389484:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145556992:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176491.389490:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176491.389507:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145557504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176491.389510:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176491.389525:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389529:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786176491.389529:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f1180 x1872931145556992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176491.389533:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176491.389540:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00080000:0.0:1786176491.389547:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176491.389553:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176491.389559:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176491.389588:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145556992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176491.389593:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145557632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176491.389609:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176491.389614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176491.389623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145556992:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176491.389631:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176491.389636:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176491.389636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145557120:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176491.389640:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176491.389649:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10225
00000100:00080000:0.0:1786176491.389653:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176491.389656:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176491.389661:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176491.389675:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145557760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176491.389675:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176491.389697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f3480 x1872931145557120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176491.389713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145557120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176491.389722:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176491.389726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176491.389730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145557120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176491.389748:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145557248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176491.389770:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176491.389794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f0700 x1872931145557248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176491.389807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145557248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176491.389822:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176491.389826:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176491.389829:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145557248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176491.389836:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145557376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176491.389857:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176491.389870:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f2d80 x1872931145557376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176491.389883:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145557376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176491.389891:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176491.389894:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176491.389921:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145557376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176491.389928:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145557504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176491.389948:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176491.389960:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f2a00 x1872931145557504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176491.389973:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145557504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176491.389982:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176491.389985:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176491.389989:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145557504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176491.389996:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145557632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176491.390017:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176491.390028:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f2680 x1872931145557632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176491.390039:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145557632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176491.390048:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176491.390051:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176491.390065:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145557632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176491.390071:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145557760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176491.390088:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176491.390097:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176491/real 1786176491]  req@ffff89d9870f1880 x1872931145557760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176491.390109:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145557760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176491.390117:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176491.390120:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176491.390123:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145557760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176491.901010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176491.901089:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176492.413014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176492.925060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176492.925144:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176493.436967:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176493.949017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176493.949095:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176494.460998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176494.973013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176494.973087:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176495.484983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176495.996985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176495.997076:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176496.509031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176496.509046:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176496.509058:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176496.509066:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176496.509080:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.509094:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176496.509107:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176496.509175:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145557888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176496.509220:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176496.509227:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176496.509229:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176496.509237:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.509245:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176496.509253:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176496.509266:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145557888:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176496.509267:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176496.509300:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145558016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176496.509371:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176496.509378:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000800:00000100:1.0:1786176496.509386:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176496.509391:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176496.509405:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.509414:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176496.509438:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176496.509448:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176496.509457:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f3100 x1872931145557888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176496.509475:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145558144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176496.509483:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145557888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176496.509515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176496.509527:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176496.509537:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145557888:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176496.509540:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176496.509546:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176496.509549:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176496.509555:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.509561:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176496.509566:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176496.509571:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145558016:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176496.509577:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176496.509600:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145558272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176496.509612:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176496.509620:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176496.509625:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176496.509628:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176496.509634:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f1500 x1872931145558016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176496.509637:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.509647:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176496.509655:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176496.509661:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176496.509662:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145558016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176496.509677:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176496.509680:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145558400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176496.509685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176496.509696:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145558016:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176496.509704:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176496.509709:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176496.509711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145558144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176496.509713:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176496.509725:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.509730:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176496.509735:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176496.509740:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176496.509746:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176496.509759:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145558528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176496.509765:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f0e00 x1872931145558144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176496.509787:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176496.509798:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176496.509802:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176496.509815:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.509820:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176496.509823:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145558144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176496.509829:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176496.509837:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176496.509841:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176496.509848:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176496.509853:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145558656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176496.509858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145558144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176496.509878:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176496.509882:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176496.509884:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176496.509888:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145558272:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176496.509894:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.509900:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176496.509904:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176496.509921:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176496.509944:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176496.509971:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145558784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176496.509977:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f3100 x1872931145558272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176496.510021:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145558272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176496.510031:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176496.510034:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176496.510038:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176496.510043:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176496.510045:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176496.510052:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145558272:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176496.510056:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10230
00000100:00080000:0.0:1786176496.510063:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176496.510065:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145558400:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176496.510073:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176496.510082:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176496.510098:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176496.510104:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145558912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176496.510115:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f1880 x1872931145558400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176496.510132:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145558400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176496.510148:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176496.510152:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176496.510155:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145558400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176496.510161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145558528:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176496.510178:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176496.510187:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f2680 x1872931145558528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176496.510198:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145558528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176496.510206:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176496.510209:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176496.510212:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145558528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176496.510217:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145558656:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176496.510230:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176496.510238:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f2a00 x1872931145558656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176496.510248:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145558656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176496.510255:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176496.510258:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176496.510262:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145558656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176496.510280:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145558784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176496.510295:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176496.510304:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f2d80 x1872931145558784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176496.510316:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145558784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176496.510341:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176496.510344:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176496.510347:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145558784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176496.510353:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145558912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176496.510387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176496.510397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176496/real 1786176496]  req@ffff89d9870f0700 x1872931145558912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176496.510409:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145558912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176496.510416:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176496.510419:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176496.510422:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145558912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176497.021031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176497.021103:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176497.533069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176498.045002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176498.045058:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176498.557037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176499.068998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176499.069072:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176499.581029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176500.092984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176500.093048:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176500.605012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176501.117047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176501.117133:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176501.629014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176501.629036:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176501.629046:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176501.629051:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176501.629062:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00080000:3.0:1786176501.629074:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176501.629082:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176501.629130:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145559040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176501.629160:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176501.629163:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176501.629164:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176501.629167:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00080000:3.0:1786176501.629170:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176501.629174:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176501.629183:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176501.629194:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145559168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176501.629204:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145559040:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176501.629207:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176501.629216:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176501.629219:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176501.629224:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00080000:3.0:1786176501.629226:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176501.629230:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176501.629234:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176501.629245:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145559296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176501.629253:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176501.629257:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176501.629259:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176501.629261:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00080000:3.0:1786176501.629266:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176501.629269:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176501.629289:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176501.629301:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145559424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176501.629308:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176501.629312:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176501.629316:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176501.629318:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176501.629323:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00080000:3.0:1786176501.629329:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176501.629332:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176501.629337:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176501.629346:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145559552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176501.629353:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176501.629357:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176501.629359:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176501.629367:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00100000:1.0:1786176501.629369:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe64a80 x1872931145559040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176501.629375:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176501.629388:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176501.629397:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176501.629405:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145559680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176501.629414:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176501.629415:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145559040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176501.629437:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176501.629443:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176501.629459:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00080000:1.0:1786176501.629460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176501.629466:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176501.629472:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176501.629475:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176501.629485:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176501.629486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145559040:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176501.629497:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145559808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176501.629505:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176501.629508:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176501.629509:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176501.629512:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00080000:3.0:1786176501.629515:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176501.629518:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176501.629524:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176501.629525:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145559168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176501.629534:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145559936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176501.629544:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176501.629547:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176501.629549:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176501.629552:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10235
00000100:00080000:3.0:1786176501.629554:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176501.629560:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176501.629568:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176501.629571:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176501.629589:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe67800 x1872931145559168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176501.629596:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145560064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176501.629605:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145559168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176501.629629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176501.629633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176501.629635:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145559168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176501.629642:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145559296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176501.629659:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176501.629666:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe67480 x1872931145559296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176501.629679:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145559296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176501.629684:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176501.629686:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176501.629688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145559296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176501.629692:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145559424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176501.629703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176501.629709:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe65880 x1872931145559424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176501.629716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145559424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176501.629721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176501.629723:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176501.629725:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145559424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176501.629728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145559552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176501.629738:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176501.629743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe67100 x1872931145559552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176501.629751:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145559552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176501.629765:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176501.629768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176501.629772:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145559552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176501.629780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145559680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176501.629799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176501.629810:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe66d80 x1872931145559680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176501.629822:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145559680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176501.629829:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176501.629833:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176501.629836:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145559680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176501.629842:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145559808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176501.629861:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176501.629871:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe66a00 x1872931145559808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176501.629883:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145559808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176501.629890:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176501.629893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176501.629922:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145559808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176501.629945:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145559936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176501.629962:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176501.629970:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe65500 x1872931145559936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176501.629978:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145559936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176501.629983:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176501.629985:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176501.629987:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145559936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176501.629991:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145560064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176501.630002:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176501.630008:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176501/real 1786176501]  req@ffff89d99fe64a80 x1872931145560064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176501.630015:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145560064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176501.630020:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176501.630023:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176501.630026:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145560064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176502.140983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176502.141032:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176502.653075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176503.165000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176503.165085:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176503.677001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176504.188981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176504.189054:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176504.701006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176505.213018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176505.213073:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176505.725017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176506.236999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176506.237088:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176506.748979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176506.748982:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176506.748989:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176506.748994:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749003:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00080000:3.0:1786176506.749011:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176506.749018:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176506.749052:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145560192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176506.749079:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176506.749082:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176506.749083:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749086:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00080000:3.0:1786176506.749088:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176506.749091:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176506.749099:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176506.749110:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145560320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176506.749111:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145560192:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176506.749125:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176506.749128:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176506.749129:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749132:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00080000:3.0:1786176506.749134:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176506.749137:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176506.749140:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176506.749155:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145560448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176506.749162:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176506.749164:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176506.749166:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749168:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00080000:3.0:1786176506.749171:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176506.749174:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176506.749178:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176506.749183:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176506.749188:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145560576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176506.749195:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176506.749197:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176506.749199:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749202:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00080000:3.0:1786176506.749204:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176506.749206:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176506.749209:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176506.749216:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145560704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176506.749239:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176506.749241:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176506.749243:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749246:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00100000:1.0:1786176506.749250:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe66680 x1872931145560192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176506.749251:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176506.749259:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176506.749266:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176506.749274:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145560192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176506.749279:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145560832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176506.749293:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176506.749301:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176506.749304:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176506.749308:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145560192:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176506.749309:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176506.749312:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749317:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00080000:3.0:1786176506.749320:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176506.749323:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176506.749325:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176506.749333:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145560960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176506.749335:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145560320:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176506.749348:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176506.749351:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176506.749352:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749355:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00080000:3.0:1786176506.749358:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176506.749361:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176506.749365:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176506.749368:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176506.749377:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145561088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176506.749381:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe64380 x1872931145560320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176506.749399:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145560320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176506.749400:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176506.749406:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176506.749409:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176506.749416:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10240
00000100:00080000:3.0:1786176506.749422:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176506.749424:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176506.749425:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176506.749432:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176506.749434:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176506.749441:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145560320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176506.749442:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145561216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176506.749455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145560448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176506.749483:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176506.749491:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe65180 x1872931145560448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176506.749503:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145560448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176506.749509:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176506.749511:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176506.749513:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145560448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176506.749523:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145560576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176506.749535:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176506.749542:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe67b80 x1872931145560576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176506.749549:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145560576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176506.749554:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176506.749556:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176506.749558:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145560576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176506.749561:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145560704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176506.749571:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176506.749576:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe65f80 x1872931145560704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176506.749584:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145560704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176506.749593:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176506.749594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176506.749596:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145560704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176506.749600:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145560832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176506.749609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176506.749614:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe64000 x1872931145560832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176506.749621:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145560832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176506.749626:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176506.749628:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176506.749630:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145560832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176506.749643:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145560960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176506.749653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176506.749659:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe66300 x1872931145560960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176506.749666:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145560960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176506.749671:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176506.749672:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176506.749675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145560960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176506.749678:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145561088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176506.749687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176506.749692:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe64700 x1872931145561088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176506.749699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145561088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176506.749704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176506.749705:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176506.749707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145561088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176506.749711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145561216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176506.749719:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176506.749724:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176506/real 1786176506]  req@ffff89d99fe66680 x1872931145561216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176506.749731:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145561216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176506.749736:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176506.749737:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176506.749739:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145561216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176507.260995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176507.261064:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176507.773035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176508.285055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176508.285070:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176508.796994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176509.309024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176509.309090:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176509.821010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176510.333017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176510.333086:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176510.845000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176511.357004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176511.357068:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176511.869046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176511.869202:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176511.869209:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176511.869214:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176511.869224:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00080000:3.0:1786176511.869236:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869246:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176511.869283:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145561344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176511.869311:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176511.869315:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176511.869317:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176511.869321:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00080000:3.0:1786176511.869325:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869329:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176511.869340:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176511.869355:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145561472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176511.869370:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145561344:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176511.869370:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176511.869385:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176511.869386:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176511.869390:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00080000:3.0:1786176511.869394:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869398:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176511.869404:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176511.869415:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145561600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176511.869422:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176511.869426:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176511.869427:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176511.869430:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00080000:3.0:1786176511.869432:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869434:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176511.869437:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176511.869445:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145561728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176511.869451:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176511.869454:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176511.869456:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176511.869459:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00080000:3.0:1786176511.869462:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869464:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176511.869467:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176511.869474:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176511.869481:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145561856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176511.869488:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176511.869491:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176511.869492:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176511.869499:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00080000:3.0:1786176511.869502:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869505:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176511.869508:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176511.869516:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145561984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176511.869522:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176511.869526:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176511.869528:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176511.869532:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00080000:3.0:1786176511.869535:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869538:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176511.869541:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176511.869544:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe64a80 x1872931145561344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176511.869552:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145562112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176511.869619:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176511.869620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145561344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176511.869638:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176511.869646:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176511.869647:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.869658:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176511.869662:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00100000:1.0:1786176511.869667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145561344:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176511.869669:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869681:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176511.869689:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176511.869700:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145562240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176511.869706:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145561472:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176511.869712:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176511.869715:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176511.869718:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176511.869723:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10246
00000100:00080000:3.0:1786176511.869727:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176511.869731:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176511.869736:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176511.869741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176511.869751:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145562368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176511.869763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe65500 x1872931145561472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176511.869775:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145561472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176511.869783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.869787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176511.869793:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145561472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176511.869799:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145561600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176511.869812:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176511.869821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe66a00 x1872931145561600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176511.869839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145561600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176511.869846:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.869848:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176511.869851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145561600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176511.869856:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145561728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176511.869871:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176511.869884:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe66d80 x1872931145561728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176511.869894:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145561728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176511.869940:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.869943:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176511.869945:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145561728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176511.869951:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145561856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176511.869984:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176511.869995:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe67100 x1872931145561856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176511.870007:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145561856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176511.870019:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.870024:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176511.870030:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145561856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176511.870039:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145561984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176511.870057:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176511.870064:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe65880 x1872931145561984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176511.870072:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145561984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176511.870077:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.870080:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176511.870083:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145561984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176511.870089:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145562112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176511.870108:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176511.870116:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe67480 x1872931145562112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176511.870133:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145562112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176511.870142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.870145:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176511.870149:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145562112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176511.870204:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145562240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176511.870234:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176511.870259:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe67800 x1872931145562240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176511.870279:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145562240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176511.870289:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.870293:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176511.870299:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145562240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176511.870309:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145562368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176511.870337:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176511.870356:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176511/real 1786176511]  req@ffff89d99fe64a80 x1872931145562368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176511.870371:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145562368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176511.870382:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176511.870386:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176511.870390:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145562368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176512.381017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176512.381093:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176512.892972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176513.405003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176513.405089:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176513.917066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176514.428974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176514.429049:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176514.940979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176515.453027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176515.453108:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176515.965008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176516.477096:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176516.477171:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786176516.989008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176516.989017:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176516.989025:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176516.989030:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176516.989040:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10251
00000100:00080000:3.0:1786176516.989049:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176516.989057:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176516.989092:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145562496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176516.989119:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176516.989140:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176516.989143:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176516.989148:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10251
00000100:00080000:3.0:1786176516.989152:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176516.989158:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145562496:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176516.989160:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176516.989172:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176516.989187:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145562624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176516.989200:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176516.989203:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176516.989206:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176516.989210:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10251
00000100:00080000:3.0:1786176516.989215:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176516.989219:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176516.989223:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176516.989229:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176516.989243:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145562752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176516.989253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176516.989257:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe66680 x1872931145562496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176516.989259:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176516.989263:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176516.989272:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10251
00000100:00080000:3.0:1786176516.989277:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176516.989282:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145562496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176516.989283:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176516.989290:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176516.989302:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145562880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176516.989333:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176516.989337:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176516.989339:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176516.989340:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176516.989344:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10251
00000100:00080000:3.0:1786176516.989350:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176516.989351:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176516.989359:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145562496:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176516.989360:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176516.989368:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176516.989380:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145563008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176516.989384:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145562624:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176516.989399:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176516.989403:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176516.989405:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176516.989412:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10251
00000800:00000100:1.0:1786176516.989415:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176516.989419:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176516.989425:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176516.989431:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176516.989435:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe64700 x1872931145562624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176516.989446:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145563136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176516.989460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145562624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176516.989461:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176516.989469:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176516.989472:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176516.989480:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10251
00000100:00080000:1.0:1786176516.989482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176516.989485:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176516.989488:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176516.989493:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176516.989495:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145562624:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176516.989499:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176516.989504:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145562752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176516.989514:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145563264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176516.989525:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176516.989526:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176516.989531:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176516.989534:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176516.989538:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe66300 x1872931145562752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176516.989542:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10251
00000100:00080000:3.0:1786176516.989549:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176516.989556:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176516.989566:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176516.989568:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145562752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176516.989576:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176516.989580:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176516.989581:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145563392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176516.989585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145562752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176516.989596:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145562880:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176516.989603:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176516.989608:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176516.989610:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176516.989617:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176516.989618:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10251
00000100:00080000:3.0:1786176516.989624:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176516.989630:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176516.989631:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe64000 x1872931145562880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176516.989636:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176516.989645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145562880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176516.989653:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145563520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176516.989654:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176516.989660:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176516.989667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145562880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176516.989699:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145563008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176516.989713:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176516.989720:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe65f80 x1872931145563008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176516.989728:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145563008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176516.989737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176516.989739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176516.989742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145563008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176516.989745:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145563136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176516.989756:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176516.989768:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe67b80 x1872931145563136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176516.989776:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145563136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176516.989781:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176516.989783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176516.989785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145563136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176516.989789:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145563264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176516.989799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176516.989805:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe65180 x1872931145563264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176516.989812:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145563264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176516.989817:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176516.989818:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176516.989820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145563264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176516.989824:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145563392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176516.989833:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176516.989839:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe64380 x1872931145563392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176516.989845:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145563392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176516.989850:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176516.989852:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176516.989854:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145563392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176516.989857:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145563520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176516.989866:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176516.989871:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176516/real 1786176516]  req@ffff89d99fe66680 x1872931145563520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176516.989878:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145563520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176541 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176516.989883:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176516.989884:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176516.989886:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145563520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176517.500986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176517.501063:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176518.013007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176518.525028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176518.525087:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176519.037014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176519.549051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176519.549149:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176520.061030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176520.573016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176520.573066:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176521.085043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176521.596992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176521.597033:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176522.109020:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176522.109030:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786176522.109036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176522.109036:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109048:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109057:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109064:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176522.109122:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145563648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176522.109145:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176522.109148:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176522.109150:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109152:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109155:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109158:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176522.109167:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176522.109178:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145563776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176522.109186:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176522.109189:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176522.109190:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109193:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109195:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109203:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176522.109207:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145563648:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176522.109208:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176522.109226:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145563904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176522.109234:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176522.109236:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176522.109237:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109241:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109243:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109245:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176522.109248:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176522.109259:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145564032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176522.109266:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176522.109270:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176522.109272:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109275:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109277:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109279:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176522.109282:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176522.109288:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145564160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176522.109294:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176522.109297:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176522.109299:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109302:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109304:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109307:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176522.109310:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176522.109316:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145564288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176522.109322:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176522.109324:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176522.109325:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109331:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109334:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109337:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176522.109341:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176522.109353:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145564416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176522.109363:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176522.109367:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145563776:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176522.109376:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176522.109385:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109393:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109399:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109404:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176522.109412:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176522.109413:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145563904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176522.109445:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145564544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176522.109454:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145564032:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176522.109464:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176522.109468:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176522.109469:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176522.109476:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10256
00000100:00080000:3.0:1786176522.109482:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176522.109487:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176522.109492:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176522.109510:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145564160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176522.109510:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145564672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176522.109559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145564288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176522.109579:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145564416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176522.109595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145564544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176522.109608:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145564672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176522.620970:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176522.621189:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176523.133154:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176523.644991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176523.645100:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176524.157029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176524.669003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176524.669115:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176525.181037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786176525.181283:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786176525.181339:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786176525.181361:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176525.181429:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786176525.181449:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176525.181463:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176525.181476:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176525.181479:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe66680 x1872931145564672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176525.181490:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176525.181506:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176525.181520:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145564672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176525.181522:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176525.181537:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176525.181543:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181557:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145564672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176525.181566:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe67800 x1872931145563776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176525.181580:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145563776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176525.181590:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181597:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145563776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176525.181604:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe67480 x1872931145563904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176525.181615:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145563904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176525.181622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181626:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145563904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176525.181636:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe65880 x1872931145564032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176525.181648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145564032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176525.181655:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181663:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145564032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176525.181671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe67100 x1872931145564160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176525.181683:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145564160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176525.181691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145564160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176525.181706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe66d80 x1872931145564288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176525.181718:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145564288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176525.181727:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181730:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145564288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176525.181741:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe64a80 x1872931145563648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176525.181753:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145563648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176525.181761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145563648:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176525.181824:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe66a00 x1872931145564416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176525.181837:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145564416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176525.181845:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181849:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181852:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145564416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176525.181859:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176522/real 1786176525]  req@ffff89d99fe65500 x1872931145564544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176525.181870:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145564544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176525.181878:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176525.181881:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176525.181885:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145564544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176525.693011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176525.693238:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176526.205123:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176526.717028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176526.717109:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176527.228967:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176527.228976:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176527.228979:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176527.228989:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10261
00000100:00080000:3.0:1786176527.228999:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176527.229008:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176527.229044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176527.229056:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145564800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176527.229081:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176527.229084:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176527.229091:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176527.229094:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10261
00000100:00080000:3.0:1786176527.229098:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176527.229102:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176527.229110:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176527.229117:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145564800:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176527.229127:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145564928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176527.229140:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176527.229144:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176527.229147:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176527.229152:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10261
00000100:00080000:3.0:1786176527.229156:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176527.229161:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176527.229166:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176527.229180:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145565056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176527.229187:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176527.229197:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176527.229201:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176527.229203:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176527.229208:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10261
00000100:00080000:3.0:1786176527.229213:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176527.229217:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176527.229223:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176527.229236:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe64380 x1872931145564800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176527.229236:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145565184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176527.229266:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176527.229270:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176527.229273:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176527.229277:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145564800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176527.229280:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10261
00000100:00080000:3.0:1786176527.229288:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176527.229296:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176527.229298:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786176527.229302:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176527.229306:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176527.229313:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145564800:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176527.229320:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145565312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176527.229330:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176527.229333:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176527.229335:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176527.229341:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145564928:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176527.229355:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10261
00000100:00080000:3.0:1786176527.229361:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176527.229367:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176527.229374:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176527.229377:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176527.229393:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145565440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176527.229398:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe65180 x1872931145564928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176527.229416:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176527.229421:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176527.229425:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145564928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176527.229425:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176527.229435:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10261
00000100:00080000:1.0:1786176527.229441:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176527.229445:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176527.229449:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176527.229454:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176527.229459:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145564928:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176527.229463:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176527.229469:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145565056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176527.229480:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145565568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176527.229490:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176527.229493:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176527.229495:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176527.229502:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10261
00000800:00000100:1.0:1786176527.229507:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176527.229509:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176527.229517:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176527.229522:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176527.229525:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe67b80 x1872931145565056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176527.229538:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145565696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176527.229542:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145565056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176527.229566:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176527.229567:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176527.229574:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176527.229575:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176527.229578:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176527.229584:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145565056:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176527.229586:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10261
00000100:00080000:3.0:1786176527.229595:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176527.229598:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145565184:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176527.229603:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176527.229611:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176527.229626:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145565824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176527.229632:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176527.229647:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe65f80 x1872931145565184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176527.229670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145565184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176527.229680:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176527.229683:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176527.229687:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145565184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176527.229693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145565312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176527.229714:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176527.229726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe64000 x1872931145565312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176527.229739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145565312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176527.229748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176527.229752:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176527.229755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145565312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176527.229777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145565440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176527.229799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176527.229811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe66300 x1872931145565440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176527.229824:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145565440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176527.229838:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176527.229842:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176527.229846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145565440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176527.229853:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145565568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176527.229873:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176527.229886:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe64700 x1872931145565568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176527.229921:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145565568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176527.229931:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176527.229934:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176527.229937:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145565568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176527.229944:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145565696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176527.229965:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176527.229975:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe64380 x1872931145565696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176527.229986:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145565696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176527.229996:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176527.229999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176527.230002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145565696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176527.230008:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145565824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176527.230042:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176527.230054:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176527/real 1786176527]  req@ffff89d99fe65500 x1872931145565824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176527.230066:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145565824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176527.230075:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176527.230078:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176527.230081:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145565824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176527.741032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176527.741140:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176528.253179:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176528.765059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176528.765156:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176529.277003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:1.0:1786176529.789130:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176529.789202:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786176530.301021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176530.813029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176530.813099:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176531.325032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176531.837071:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176531.837122:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176532.349000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176532.349003:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176532.349012:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176532.349017:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176532.349026:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00080000:3.0:1786176532.349035:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176532.349044:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176532.349081:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145565952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176532.349109:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176532.349113:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176532.349114:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176532.349119:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00080000:3.0:1786176532.349124:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176532.349128:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176532.349138:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176532.349141:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145565952:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176532.349167:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145566080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176532.349179:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176532.349182:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176532.349184:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176532.349189:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00080000:3.0:1786176532.349193:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176532.349200:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176532.349201:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176532.349208:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176532.349222:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145566208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176532.349234:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176532.349239:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe66a00 x1872931145565952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349240:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176532.349244:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176532.349256:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00080000:3.0:1786176532.349260:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176532.349261:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145565952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349270:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176532.349275:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786176532.349279:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176532.349281:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349286:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145565952:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176532.349297:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145566336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176532.349306:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145566080:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176532.349312:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176532.349318:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176532.349320:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176532.349328:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176532.349328:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00080000:3.0:1786176532.349336:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176532.349343:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe64a80 x1872931145566080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349345:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176532.349354:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176532.349359:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145566080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176532.349366:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176532.349368:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349373:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145566080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176532.349375:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145566464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176532.349379:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145566208:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176532.349393:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176532.349397:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:1.0:1786176532.349399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176532.349401:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176532.349410:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe66d80 x1872931145566208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349410:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00080000:3.0:1786176532.349418:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176532.349423:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145566208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349427:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176532.349437:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176532.349438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176532.349444:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145566208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176532.349458:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145566592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176532.349460:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145566336:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176532.349477:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176532.349481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176532.349484:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176532.349489:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176532.349492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe67100 x1872931145566336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349504:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00100000:1.0:1786176532.349508:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145566336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349511:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176532.349519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176532.349520:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176532.349525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349529:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145566336:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786176532.349530:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176532.349535:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145566464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176532.349550:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145566720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176532.349553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176532.349562:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe65880 x1872931145566464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349568:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176532.349574:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145566464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349574:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176532.349579:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176532.349588:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176532.349590:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00080000:1.0:1786176532.349593:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349598:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145566464:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176532.349598:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176532.349606:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176532.349609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145566592:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176532.349614:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176532.349628:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176532.349638:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe67480 x1872931145566592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176532.349640:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145566848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176532.349653:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145566592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176532.349663:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176532.349672:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176532.349676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176532.349677:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176532.349680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349686:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145566592:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176532.349688:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10266
00000100:00100000:1.0:1786176532.349693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145566720:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176532.349696:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176532.349703:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176532.349708:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176532.349709:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176532.349717:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe67800 x1872931145566720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176532.349726:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145566976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176532.349727:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145566720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176532.349756:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176532.349761:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145566720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176532.349773:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145566848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176532.349786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176532.349795:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe66680 x1872931145566848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176532.349803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145566848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176532.349808:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176532.349809:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349812:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145566848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176532.349815:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145566976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176532.349825:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176532.349830:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176532/real 1786176532]  req@ffff89d99fe65880 x1872931145566976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176532.349837:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145566976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176532.349843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176532.349844:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176532.349846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145566976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176532.861077:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176532.861148:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176533.373066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176533.885057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176533.885150:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176534.396996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176534.909175:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176534.909384:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786176535.421049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176535.933011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176535.933108:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176536.444972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176536.957002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176536.957066:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176537.468996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176537.469022:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176537.469034:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176537.469040:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176537.469052:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:3.0:1786176537.469075:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176537.469084:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176537.469139:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145567104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176537.469175:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176537.469179:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176537.469181:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176537.469187:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:3.0:1786176537.469192:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176537.469199:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176537.469214:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176537.469217:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145567104:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176537.469230:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145567232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176537.469244:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176537.469246:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176537.469248:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176537.469253:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:3.0:1786176537.469258:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176537.469262:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176537.469267:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176537.469276:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145567360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176537.469285:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176537.469294:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176537.469298:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176537.469301:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176537.469306:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:3.0:1786176537.469311:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176537.469323:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176537.469329:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176537.469339:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe67100 x1872931145567104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176537.469345:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145567488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176537.469369:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176537.469372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145567104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176537.469373:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176537.469380:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176537.469399:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:1.0:1786176537.469402:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176537.469408:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176537.469409:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176537.469423:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145567104:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176537.469424:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176537.469443:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176537.469455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145567232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176537.469463:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145567616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176537.469477:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176537.469480:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176537.469483:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176537.469484:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176537.469491:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:3.0:1786176537.469497:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176537.469501:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe66d80 x1872931145567232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176537.469508:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176537.469521:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176537.469528:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145567232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176537.469537:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176537.469541:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176537.469546:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145567744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176537.469548:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145567232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176537.469565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145567360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176537.469588:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176537.469591:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176537.469594:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176537.469601:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176537.469608:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:3.0:1786176537.469614:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176537.469618:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176537.469623:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176537.469625:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe64a80 x1872931145567360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176537.469636:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145567872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176537.469646:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176537.469651:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786176537.469652:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145567360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176537.469654:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176537.469664:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:3.0:1786176537.469670:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176537.469679:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176537.469685:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176537.469694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176537.469696:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145568000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176537.469712:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176537.469713:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176537.469724:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176537.469726:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176537.469730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145567360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176537.469738:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10271
00000100:00080000:3.0:1786176537.469744:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176537.469746:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145567488:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176537.469752:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176537.469770:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176537.469780:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176537.469782:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145568128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176537.469793:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe66a00 x1872931145567488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176537.469804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145567488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176537.469810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176537.469814:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176537.469817:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145567488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176537.469836:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145567616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176537.469849:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176537.469856:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe65500 x1872931145567616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176537.469863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145567616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176537.469868:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176537.469870:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176537.469871:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145567616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176537.469875:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145567744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176537.469886:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176537.469892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe64380 x1872931145567744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176537.469920:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145567744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176537.469940:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176537.469942:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176537.469945:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145567744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176537.469950:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145567872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176537.469966:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176537.469974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe64700 x1872931145567872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176537.469982:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145567872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176537.469987:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176537.469989:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176537.469991:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145567872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176537.469995:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145568000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176537.470005:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176537.470011:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe66300 x1872931145568000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176537.470017:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145568000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176537.470023:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176537.470025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176537.470026:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145568000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176537.470030:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145568128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176537.470040:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176537.470046:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176537/real 1786176537]  req@ffff89d99fe64000 x1872931145568128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176537.470053:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145568128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176537.470058:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176537.470060:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176537.470062:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145568128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176537.981078:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176537.981153:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176538.493063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176539.004995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176539.005106:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176539.517072:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176540.029028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176540.029100:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176540.541062:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176541.053008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176541.053069:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176541.565039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176542.077028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176542.077095:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176542.589010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176542.589018:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176542.589025:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176542.589030:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176542.589039:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589052:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176542.589058:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176542.589090:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145568256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176542.589111:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176542.589113:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176542.589115:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176542.589117:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589120:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176542.589123:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176542.589130:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176542.589138:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145568384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176542.589146:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176542.589149:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176542.589151:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176542.589155:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145568256:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176542.589156:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589159:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176542.589164:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176542.589169:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176542.589176:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145568512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176542.589183:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176542.589185:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176542.589186:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176542.589189:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589190:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176542.589193:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176542.589196:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176542.589203:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145568640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176542.589208:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176542.589211:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176542.589212:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176542.589215:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589218:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176542.589220:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176542.589222:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176542.589228:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176542.589232:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145568768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176542.589239:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176542.589241:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176542.589243:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176542.589246:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589255:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176542.589258:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176542.589261:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176542.589270:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145568896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176542.589278:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176542.589279:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f3480 x1872931145568256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176542.589282:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176542.589285:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176542.589290:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589295:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176542.589300:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176542.589305:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176542.589312:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145569024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176542.589316:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145568256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176542.589321:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176542.589327:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176542.589331:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176542.589338:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589341:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176542.589343:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176542.589344:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176542.589350:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176542.589353:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176542.589359:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145569152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176542.589363:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145568256:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176542.589371:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176542.589375:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176542.589376:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176542.589379:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10276
00000100:00080000:0.0:1786176542.589381:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176542.589384:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176542.589387:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176542.589392:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145569280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176542.589399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145568384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176542.589429:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176542.589444:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f1180 x1872931145568384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176542.589460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145568384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176542.589470:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176542.589474:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176542.589478:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145568384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176542.589485:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145568512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176542.589506:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176542.589519:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f0a80 x1872931145568512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176542.589533:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145568512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176542.589555:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176542.589559:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176542.589562:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145568512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176542.589569:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145568640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176542.589592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176542.589604:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f3b80 x1872931145568640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176542.589618:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145568640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176542.589627:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176542.589630:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176542.589634:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145568640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176542.589642:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145568768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176542.589662:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176542.589674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f0700 x1872931145568768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176542.589688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145568768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176542.589696:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176542.589699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176542.589703:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145568768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176542.589710:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145568896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176542.589730:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176542.589742:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f2d80 x1872931145568896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176542.589756:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145568896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176542.589765:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176542.589769:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176542.589772:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145568896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176542.589779:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145569024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176542.589798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176542.589811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f2a00 x1872931145569024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176542.589825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145569024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176542.589835:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176542.589838:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176542.589841:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145569024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176542.589848:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145569152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176542.589867:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176542.589895:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f2680 x1872931145569152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176542.589930:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145569152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176542.589939:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176542.589943:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176542.589946:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145569152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176542.589972:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145569280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176542.589994:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176542.590006:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176542/real 1786176542]  req@ffff89d9870f1880 x1872931145569280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176542.590019:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145569280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176542.590028:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176542.590032:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176542.590036:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145569280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176543.100978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176543.101038:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176543.613000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176544.125024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176544.125096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176544.637039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176545.149001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176545.149160:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176545.661040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176546.173051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176546.173137:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176546.685034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176547.197005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176547.197066:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176547.708985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176547.709009:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176547.709016:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176547.709021:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176547.709031:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00080000:3.0:1786176547.709041:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176547.709050:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176547.709084:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145569408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176547.709114:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176547.709118:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176547.709120:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176547.709125:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00080000:3.0:1786176547.709130:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176547.709135:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176547.709146:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145569408:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176547.709154:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176547.709173:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145569536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176547.709186:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176547.709189:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176547.709192:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176547.709198:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00080000:3.0:1786176547.709203:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176547.709205:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176547.709211:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176547.709218:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176547.709247:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe65f80 x1872931145569408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176547.709268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145569408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176547.709277:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176547.709280:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176547.709283:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145569408:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176547.709303:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145569664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176547.709304:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145569536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176547.709324:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176547.709329:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176547.709331:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176547.709335:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176547.709341:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00100000:0.0:1786176547.709344:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe67b80 x1872931145569536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176547.709347:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176547.709357:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176547.709359:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145569536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176547.709365:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176547.709367:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176547.709372:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176547.709376:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145569536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176547.709384:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145569792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176547.709387:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145569664:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176547.709404:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176547.709409:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176547.709411:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176547.709415:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176547.709420:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe65180 x1872931145569664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176547.709421:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00080000:3.0:1786176547.709429:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176547.709435:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176547.709438:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145569664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176547.709442:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176547.709456:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176547.709462:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145569920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176547.709463:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176547.709472:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145569664:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176547.709482:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176547.709486:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176547.709489:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176547.709493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145569792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176547.709512:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176547.709520:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe65f80 x1872931145569792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176547.709529:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145569792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176547.709535:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176547.709537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176547.709539:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145569792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176547.709543:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145569920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176547.709555:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176547.709560:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe64000 x1872931145569920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176547.709569:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145569920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176547.709574:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176547.709577:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176547.709579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145569920:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176547.709623:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00080000:3.0:1786176547.709629:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176547.709635:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176547.709642:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176547.709710:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145570048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176547.709734:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176547.709739:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176547.709741:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176547.709747:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00100000:0.0:1786176547.709749:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145570048:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176547.709755:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176547.709762:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176547.709768:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176547.709784:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145570176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176547.709791:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176547.709802:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176547.709806:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176547.709809:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176547.709812:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe66300 x1872931145570048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176547.709817:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00080000:3.0:1786176547.709824:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176547.709847:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145570048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176547.709855:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176547.709858:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176547.709862:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176547.709863:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145570048:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176547.709875:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176547.709876:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145570176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176547.709924:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176547.709941:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145570304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176547.709945:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe64700 x1872931145570176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176547.709970:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176547.709975:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786176547.709977:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145570176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176547.709979:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176547.709989:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10281
00000100:00080000:0.0:1786176547.709995:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176547.709997:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176547.710005:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176547.710007:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176547.710012:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145570176:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176547.710017:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176547.710026:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145570304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176547.710036:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145570432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176547.710049:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176547.710061:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe64380 x1872931145570304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176547.710071:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145570304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176547.710077:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176547.710079:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176547.710082:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145570304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176547.710090:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145570432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176547.710101:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176547.710107:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176547/real 1786176547]  req@ffff89d99fe65500 x1872931145570432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176547.710114:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145570432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176547.710119:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176547.710121:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176547.710123:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145570432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176548.221016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176548.221061:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176548.733015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176549.244972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176549.245055:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176549.757016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176550.268965:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176550.269031:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176550.781042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176551.293030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176551.293110:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176551.805013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176552.316972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176552.317031:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176552.828961:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176552.828972:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1786176552.828974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176552.828977:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176552.828989:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00080000:3.0:1786176552.829000:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176552.829009:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176552.829055:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145570560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176552.829077:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176552.829080:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176552.829081:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176552.829084:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00080000:3.0:1786176552.829087:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176552.829091:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176552.829099:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176552.829109:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145570560:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176552.829112:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145570688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176552.829121:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176552.829124:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176552.829125:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176552.829128:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00080000:3.0:1786176552.829131:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176552.829133:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176552.829138:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176552.829151:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145570816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176552.829161:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176552.829166:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176552.829168:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176552.829172:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176552.829177:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00080000:3.0:1786176552.829183:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176552.829186:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176552.829190:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176552.829200:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145570944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176552.829209:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe66a00 x1872931145570560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176552.829210:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176552.829220:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176552.829226:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176552.829232:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00100000:0.0:1786176552.829235:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145570560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176552.829238:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176552.829248:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176552.829249:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176552.829256:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176552.829257:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176552.829261:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145570560:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176552.829272:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145571072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176552.829279:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176552.829281:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176552.829282:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176552.829285:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00080000:3.0:1786176552.829288:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176552.829290:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145570688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176552.829294:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176552.829299:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176552.829307:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145571200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176552.829314:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176552.829317:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176552.829320:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786176552.829322:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176552.829326:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00080000:3.0:1786176552.829331:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176552.829334:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176552.829337:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176552.829344:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe64a80 x1872931145570688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176552.829346:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145571328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176552.829378:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176552.829380:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176552.829382:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176552.829384:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145570688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176552.829387:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00080000:3.0:1786176552.829393:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176552.829399:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176552.829400:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786176552.829402:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176552.829405:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176552.829410:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145570688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176552.829414:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145571456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176552.829421:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176552.829425:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786176552.829428:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145570816:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176552.829428:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176552.829437:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10287
00000100:00080000:3.0:1786176552.829440:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176552.829443:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176552.829446:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176552.829454:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145571584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176552.829458:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176552.829477:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe66d80 x1872931145570816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176552.829493:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145570816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176552.829502:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176552.829506:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176552.829509:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145570816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176552.829515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145570944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176552.829532:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176552.829540:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe67100 x1872931145570944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176552.829547:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145570944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176552.829553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176552.829555:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176552.829557:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145570944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176552.829560:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145571072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176552.829572:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176552.829581:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe65880 x1872931145571072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176552.829602:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145571072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176552.829610:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176552.829613:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176552.829616:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145571072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176552.829630:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145571200:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176552.829646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176552.829653:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe66680 x1872931145571200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176552.829661:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145571200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176552.829666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176552.829668:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176552.829670:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145571200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176552.829673:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145571328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176552.829682:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176552.829688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe67800 x1872931145571328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176552.829695:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145571328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176552.829704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176552.829706:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176552.829708:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145571328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176552.829711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145571456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176552.829720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176552.829725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe67480 x1872931145571456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176552.829732:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145571456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176552.829737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176552.829739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176552.829740:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145571456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176552.829744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145571584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176552.829753:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176552.829758:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176552/real 1786176552]  req@ffff89d99fe66a00 x1872931145571584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176552.829765:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145571584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176552.829770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176552.829772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176552.829774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145571584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176553.341015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176553.341080:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176553.852951:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176554.365007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176554.365057:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176554.876980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176555.389022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176555.389113:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176555.900993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176556.412996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176556.413082:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176556.924998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176557.437018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176557.437093:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176557.949010:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176557.949022:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176557.949027:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176557.949041:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00100000:2.0:1786176557.949052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176557.949053:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949063:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176557.949110:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145571712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176557.949141:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176557.949146:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176557.949148:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176557.949153:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00080000:3.0:1786176557.949158:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949164:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176557.949186:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176557.949187:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145571712:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176557.949202:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145571840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176557.949212:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176557.949215:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176557.949216:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176557.949220:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00080000:3.0:1786176557.949223:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949226:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176557.949235:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176557.949245:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145571968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176557.949252:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176557.949255:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176557.949257:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176557.949259:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00080000:3.0:1786176557.949262:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949264:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176557.949267:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176557.949276:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176557.949278:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145572096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176557.949286:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176557.949289:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176557.949292:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176557.949300:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00080000:3.0:1786176557.949305:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949309:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176557.949313:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176557.949326:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145572224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176557.949337:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176557.949341:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176557.949343:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176557.949347:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe65500 x1872931145571712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176557.949351:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00080000:3.0:1786176557.949357:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949366:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176557.949371:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176557.949381:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145571712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176557.949384:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145572352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176557.949405:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176557.949406:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176557.949412:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176557.949414:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176557.949415:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176557.949420:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145571712:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176557.949422:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00080000:3.0:1786176557.949428:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949431:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176557.949434:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176557.949442:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145572480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176557.949450:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176557.949453:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145571840:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176557.949454:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176557.949458:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176557.949463:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00080000:3.0:1786176557.949466:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949469:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176557.949473:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176557.949492:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176557.949492:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145572608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176557.949502:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176557.949505:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786176557.949507:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe64380 x1872931145571840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176557.949508:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176557.949515:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10292
00000100:00080000:3.0:1786176557.949521:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176557.949527:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176557.949532:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145571840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176557.949533:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176557.949544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176557.949546:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145572736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176557.949550:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176557.949557:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145571840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176557.949566:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145571968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176557.949582:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176557.949589:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe64700 x1872931145571968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176557.949597:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145571968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176557.949603:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176557.949604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176557.949606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145571968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176557.949610:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145572096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176557.949622:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176557.949627:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe66300 x1872931145572096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176557.949635:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145572096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176557.949640:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176557.949642:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176557.949644:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145572096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176557.949647:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145572224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176557.949657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176557.949662:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe64000 x1872931145572224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176557.949670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145572224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176557.949675:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176557.949677:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176557.949679:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145572224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176557.949682:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145572352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176557.949692:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176557.949697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe65f80 x1872931145572352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176557.949704:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145572352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176557.949708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176557.949711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176557.949713:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145572352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176557.949724:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145572480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176557.949751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176557.949760:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe65180 x1872931145572480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176557.949768:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145572480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176557.949778:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176557.949780:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176557.949783:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145572480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176557.949787:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145572608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176557.949798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176557.949804:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe67b80 x1872931145572608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176557.949811:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145572608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176557.949817:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176557.949819:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176557.949829:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145572608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176557.949840:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145572736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176557.949861:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176557.949873:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176557/real 1786176557]  req@ffff89d99fe65500 x1872931145572736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176557.949886:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145572736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176557.949895:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176557.949923:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176557.949927:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145572736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176558.460973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176558.461052:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176558.972999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176559.484989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176559.485052:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176559.997004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176560.508970:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176560.509027:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176561.020988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176561.533009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176561.533064:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176562.045024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176562.556986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176562.557044:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176563.069000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176563.069020:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069027:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176563.069031:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069039:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:1.0:1786176563.069048:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176563.069054:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176563.069088:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145572864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176563.069108:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069111:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176563.069112:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069115:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:1.0:1786176563.069118:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176563.069121:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176563.069129:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176563.069147:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145572864:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176563.069148:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145572992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176563.069165:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069168:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176563.069170:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069172:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:1.0:1786176563.069175:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176563.069178:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176563.069182:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176563.069191:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145573120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176563.069198:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069201:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176563.069202:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069204:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:1.0:1786176563.069206:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176563.069209:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176563.069212:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176563.069217:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176563.069225:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145573248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176563.069232:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069234:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176563.069235:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069238:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:1.0:1786176563.069241:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176563.069244:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176563.069249:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2fc700 x1872931145572864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176563.069250:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176563.069261:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145573376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176563.069268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145572864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176563.069270:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069277:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176563.069281:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069288:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:0.0:1786176563.069290:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176563.069291:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176563.069298:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176563.069299:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786176563.069302:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176563.069306:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145572864:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176563.069313:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145573504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176563.069320:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069323:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176563.069324:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069327:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:1.0:1786176563.069329:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176563.069331:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145572992:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176563.069334:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176563.069340:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176563.069351:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145573632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176563.069360:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176563.069370:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069374:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1786176563.069375:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2fce00 x1872931145572992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176563.069376:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069385:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:1.0:1786176563.069391:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176563.069396:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176563.069397:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145572992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176563.069400:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176563.069410:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176563.069414:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145573760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176563.069417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176563.069421:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145572992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176563.069429:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145573120:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176563.069433:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176563.069438:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176563.069440:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176563.069444:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10297
00000100:00080000:1.0:1786176563.069447:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176563.069451:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176563.069454:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176563.069460:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176563.069465:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2fd880 x1872931145573120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176563.069471:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145573888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176563.069481:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145573120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176563.069489:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176563.069492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176563.069494:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145573120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176563.069500:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145573248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176563.069512:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176563.069518:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2fe680 x1872931145573248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176563.069525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145573248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176563.069531:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176563.069532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176563.069534:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145573248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176563.069537:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145573376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176563.069547:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176563.069552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2fe300 x1872931145573376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176563.069560:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145573376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176563.069565:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176563.069567:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176563.069569:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145573376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176563.069572:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145573504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176563.069581:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176563.069586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2fdc00 x1872931145573504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176563.069594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145573504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176563.069599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176563.069600:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176563.069602:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145573504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176563.069617:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145573632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176563.069635:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176563.069648:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2ff480 x1872931145573632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176563.069660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145573632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176563.069675:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176563.069693:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176563.069697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145573632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176563.069703:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145573760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176563.069720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176563.069729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2fc700 x1872931145573760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176563.069736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145573760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176563.069742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176563.069744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176563.069746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145573760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176563.069750:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145573888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176563.069760:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176563.069765:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176563/real 1786176563]  req@ffff89d9ba2ff800 x1872931145573888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176563.069772:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145573888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176563.069777:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176563.069779:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176563.069782:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145573888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176563.581040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176563.581072:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176564.093012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176564.604972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176564.605016:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176565.117020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176565.629095:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176565.629172:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176566.141010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176566.652979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176566.653030:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176567.164987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176567.676966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176567.677121:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176568.189018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176568.189023:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176568.189043:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176568.189049:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176568.189064:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00080000:1.0:1786176568.189078:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176568.189088:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176568.189140:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145574016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176568.189171:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176568.189176:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176568.189178:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176568.189183:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00080000:1.0:1786176568.189188:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176568.189193:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176568.189205:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176568.189213:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145574016:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176568.189221:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145574144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176568.189235:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176568.189239:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176568.189241:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176568.189245:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00080000:1.0:1786176568.189248:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176568.189252:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176568.189256:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176568.189268:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145574272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176568.189277:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176568.189281:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176568.189284:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176568.189288:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00080000:1.0:1786176568.189292:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176568.189297:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176568.189303:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176568.189309:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176568.189324:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145574400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176568.189338:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176568.189342:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176568.189344:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176568.189349:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00080000:1.0:1786176568.189353:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176568.189358:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176568.189363:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176568.189368:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2fd500 x1872931145574016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176568.189379:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145574528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176568.189391:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145574016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176568.189391:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176568.189401:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176568.189405:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176568.189410:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176568.189413:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00080000:0.0:1786176568.189417:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176568.189419:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176568.189427:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176568.189433:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145574016:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786176568.189433:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176568.189447:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145574656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176568.189457:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176568.189462:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786176568.189465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145574144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176568.189466:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176568.189477:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00080000:1.0:1786176568.189481:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176568.189485:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176568.189490:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786176568.189495:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176568.189506:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145574784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176568.189509:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2fea00 x1872931145574144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176568.189539:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176568.189540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145574144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176568.189551:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176568.189556:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176568.189556:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176568.189563:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176568.189567:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00100000:0.0:1786176568.189571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145574144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176568.189574:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176568.189578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145574272:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176568.189583:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176568.189591:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176568.189600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176568.189607:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145574912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176568.189611:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2fed80 x1872931145574272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176568.189648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145574272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176568.189655:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176568.189657:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176568.189660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145574272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176568.189664:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145574400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176568.189686:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176568.189694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2fd180 x1872931145574400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176568.189703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145574400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176568.189716:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176568.189725:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176568.189725:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176568.189731:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176568.189732:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176568.189740:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145574400:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786176568.189743:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10302
00000100:00100000:0.0:1786176568.189748:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145574528:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786176568.189750:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176568.189757:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176568.189764:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176568.189765:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176568.189777:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2ff100 x1872931145574528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176568.189785:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145575040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176568.189791:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145574528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176568.189813:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176568.189817:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176568.189820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145574528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176568.189824:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145574656:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176568.189838:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176568.189844:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2ffb80 x1872931145574656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176568.189852:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145574656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176568.189857:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176568.189859:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176568.189860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145574656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176568.189878:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145574784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176568.189889:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176568.189915:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2fdf80 x1872931145574784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176568.189925:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145574784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176568.189932:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176568.189934:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176568.189936:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145574784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176568.189940:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145574912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176568.189953:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176568.189960:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2fc380 x1872931145574912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176568.189968:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145574912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176568.189974:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176568.189975:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176568.189977:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145574912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176568.189981:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145575040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176568.189991:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176568.189997:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176568/real 1786176568]  req@ffff89d9ba2fd500 x1872931145575040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176568.190004:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145575040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176568.190010:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176568.190011:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176568.190014:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145575040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176568.701009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176568.701100:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176569.213063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176569.725044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176569.725174:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176570.237030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176570.749026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176570.749128:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176571.261032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176571.773020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176571.773071:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176572.284989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176572.797012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176572.797087:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176573.308997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176573.309107:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309115:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176573.309119:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176573.309130:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309139:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176573.309147:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176573.309181:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145575168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176573.309204:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176573.309208:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176573.309211:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309214:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176573.309216:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176573.309243:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176573.309247:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145575168:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176573.309260:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145575296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176573.309275:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309279:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176573.309282:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176573.309287:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309292:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176573.309296:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176573.309301:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176573.309314:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145575424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176573.309316:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176573.309326:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309329:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176573.309331:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176573.309334:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309338:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176573.309340:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176573.309344:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176573.309352:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145575552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176573.309359:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309362:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176573.309365:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176573.309366:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87f100 x1872931145575168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176573.309369:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309372:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176573.309377:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176573.309385:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176573.309396:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145575680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176573.309404:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145575168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176573.309405:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309417:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176573.309419:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176573.309420:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176573.309424:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309428:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176573.309429:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176573.309433:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176573.309439:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145575168:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176573.309440:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176573.309454:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145575808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176573.309464:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309467:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176573.309468:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176573.309472:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145575296:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176573.309474:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309479:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176573.309483:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176573.309486:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176573.309494:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145575936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176573.309502:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309505:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176573.309507:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786176573.309510:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176573.309514:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309519:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176573.309522:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176573.309531:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176573.309532:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87c000 x1872931145575296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176573.309545:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145575296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176573.309553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786176573.309554:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145576064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176573.309558:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176573.309565:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145575296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176573.309576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145575424:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176573.309597:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176573.309601:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176573.309603:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176573.309610:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10307
00000100:00080000:2.0:1786176573.309615:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176573.309620:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786176573.309626:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176573.309630:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176573.309637:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87d500 x1872931145575424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176573.309645:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145576192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176573.309651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145575424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176573.309666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176573.309669:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176573.309671:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145575424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176573.309678:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145575552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176573.309690:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176573.309696:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87c380 x1872931145575552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176573.309703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145575552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176573.309709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176573.309710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176573.309712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145575552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176573.309716:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145575680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176573.309725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176573.309732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87df80 x1872931145575680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176573.309744:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145575680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176573.309752:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176573.309755:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176573.309758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145575680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176573.309764:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145575808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176573.309783:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176573.309799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87e680 x1872931145575808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176573.309811:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145575808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176573.309818:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176573.309821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176573.309824:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145575808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176573.309842:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145575936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176573.309861:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176573.309873:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87dc00 x1872931145575936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176573.309885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145575936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176573.309894:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176573.309915:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176573.309917:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145575936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176573.309922:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145576064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176573.309937:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176573.309945:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87ca80 x1872931145576064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176573.309952:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145576064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176573.309958:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176573.309960:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176573.309962:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145576064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176573.309965:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145576192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176573.309974:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176573.309980:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176573/real 1786176573]  req@ffff89d99e87ed80 x1872931145576192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176573.309987:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145576192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176573.309992:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176573.309993:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176573.309996:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145576192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176573.821004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176573.821084:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176574.333012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176574.845052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176574.845131:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176575.356973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176575.869013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176575.869075:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176576.381063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176576.892966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176576.893099:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176577.405016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176577.917041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176577.917115:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176578.429084:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176578.429091:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176578.429097:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176578.429104:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176578.429119:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429132:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429141:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176578.429190:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145576320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176578.429218:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176578.429222:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176578.429223:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176578.429227:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429231:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429235:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176578.429247:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176578.429263:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145576448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176578.429276:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176578.429279:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176578.429281:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176578.429286:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145576320:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176578.429287:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429295:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429300:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176578.429304:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176578.429315:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145576576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176578.429322:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176578.429324:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176578.429326:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176578.429330:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429335:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429340:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176578.429346:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176578.429360:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145576704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176578.429372:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176578.429378:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176578.429379:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176578.429383:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176578.429388:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429392:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429395:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176578.429400:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176578.429410:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145576832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176578.429417:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176578.429420:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176578.429421:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176578.429424:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429426:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429429:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176578.429432:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176578.429440:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145576960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176578.429452:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176578.429454:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe66a00 x1872931145576320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176578.429456:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176578.429460:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176578.429467:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429472:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429477:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176578.429481:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176578.429494:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145576320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176578.429496:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145577088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176578.429527:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176578.429544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.429552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176578.429556:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1786176578.429558:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145576320:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176578.429559:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176578.429567:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429572:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429576:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176578.429580:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176578.429589:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145577216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176578.429597:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145576448:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176578.429600:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176578.429606:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176578.429608:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176578.429614:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10312
00000100:00080000:3.0:1786176578.429620:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176578.429625:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176578.429631:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176578.429633:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176578.429649:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145577344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176578.429653:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe67480 x1872931145576448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176578.429680:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145576448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176578.429689:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.429693:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176578.429699:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145576448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176578.429718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145576576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176578.429739:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176578.429751:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe67800 x1872931145576576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176578.429763:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145576576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176578.429771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.429774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176578.429778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145576576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176578.429784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145576704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176578.429803:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176578.429813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe66680 x1872931145576704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176578.429825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145576704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176578.429832:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.429836:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176578.429839:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145576704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176578.429845:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145576832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176578.429862:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176578.429883:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe65880 x1872931145576832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176578.429941:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145576832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176578.429951:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.429955:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176578.429958:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145576832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176578.429965:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145576960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176578.429997:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176578.430009:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe67100 x1872931145576960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176578.430021:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145576960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176578.430029:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.430032:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176578.430036:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145576960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176578.430041:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145577088:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176578.430060:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176578.430071:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe66d80 x1872931145577088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176578.430082:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145577088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176578.430091:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.430094:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176578.430097:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145577088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176578.430119:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145577216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176578.430137:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176578.430148:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe64a80 x1872931145577216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176578.430160:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145577216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176578.430168:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.430172:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176578.430175:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145577216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176578.430181:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145577344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176578.430200:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176578.430212:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176578/real 1786176578]  req@ffff89d99fe66a00 x1872931145577344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176578.430224:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145577344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176578.430232:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176578.430235:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176578.430239:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145577344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176578.941005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176578.941093:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176579.453036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176579.965001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176579.965066:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176580.477020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176580.989013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176580.989114:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176581.501025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176582.012973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176582.013051:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176582.525012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176583.037021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176583.037063:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176583.549051:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176583.549059:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176583.549063:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176583.549072:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00080000:3.0:1786176583.549081:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176583.549087:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176583.549108:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176583.549121:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145577472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176583.549145:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176583.549150:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176583.549152:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176583.549157:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00080000:3.0:1786176583.549163:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176583.549169:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176583.549177:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145577472:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176583.549180:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176583.549200:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145577600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176583.549211:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176583.549214:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176583.549216:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176583.549219:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00080000:3.0:1786176583.549225:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176583.549230:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176583.549236:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786176583.549242:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176583.549259:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145577728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176583.549267:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176583.549270:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176583.549271:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176583.549274:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00080000:3.0:1786176583.549278:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176583.549282:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176583.549287:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176583.549288:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe65500 x1872931145577472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176583.549302:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145577856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176583.549310:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145577472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176583.549331:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176583.549335:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176583.549335:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176583.549339:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176583.549343:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176583.549347:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00100000:0.0:1786176583.549351:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145577472:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176583.549353:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176583.549361:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176583.549365:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176583.549381:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145577600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176583.549399:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176583.549409:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe67b80 x1872931145577600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176583.549419:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145577600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176583.549426:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176583.549429:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176583.549431:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145577600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176583.549436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145577728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176583.549449:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176583.549458:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe65180 x1872931145577728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176583.549462:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145577984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176583.549476:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145577728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176583.549479:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176583.549497:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176583.549499:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176583.549502:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176583.549503:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176583.549510:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145577728:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176583.549512:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00100000:0.0:1786176583.549519:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145577856:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176583.549519:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176583.549526:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176583.549532:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786176583.549541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176583.549546:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145578112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176583.549552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe65f80 x1872931145577856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176583.549558:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176583.549566:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176583.549568:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176583.549570:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145577856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176583.549574:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00080000:3.0:1786176583.549580:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176583.549585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176583.549586:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176583.549592:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176583.549593:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176583.549598:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145577856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176583.549604:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145578240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176583.549614:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145577984:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176583.549614:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176583.549624:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176583.549626:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176583.549629:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00080000:3.0:1786176583.549633:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176583.549636:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786176583.549642:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176583.549644:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176583.549653:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe64000 x1872931145577984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176583.549657:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145578368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176583.549668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145577984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176583.549674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176583.549676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176583.549678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145577984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176583.549681:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145578112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176583.549693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176583.549698:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe66300 x1872931145578112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176583.549706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145578112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176583.549711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176583.549713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176583.549715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145578112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176583.549725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145578240:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176583.549738:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176583.549745:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe64700 x1872931145578240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176583.549758:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145578240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176583.549779:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176583.549780:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176583.549786:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176583.549787:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176583.549791:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176583.549794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145578240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176583.549802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145578368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176583.549815:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176583.549826:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10317
00000100:00080000:3.0:1786176583.549832:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176583.549835:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe64380 x1872931145578368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176583.549841:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176583.549850:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176583.549854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145578368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176583.549868:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176583.549870:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145578496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176583.549874:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176583.549881:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145578368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176583.549937:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145578496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176583.549956:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176583.549965:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176583/real 1786176583]  req@ffff89d99fe64700 x1872931145578496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176583.549972:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145578496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176583.549983:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176583.549985:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176583.549987:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145578496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176584.060966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176584.061048:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176584.573056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176585.085029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176585.085078:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176585.597032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176586.109017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176586.109122:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176586.621006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176587.132994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176587.133062:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176587.645098:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176588.156992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176588.157084:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176588.668988:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176588.668993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176588.668997:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176588.669002:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669012:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669021:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176588.669029:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176588.669068:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145578624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176588.669092:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176588.669095:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176588.669096:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669099:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669102:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176588.669105:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176588.669114:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176588.669124:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145578624:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176588.669126:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145578752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176588.669137:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176588.669140:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176588.669142:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669145:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669148:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176588.669150:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176588.669154:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176588.669162:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145578880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176588.669168:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176588.669171:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176588.669172:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669175:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669177:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176588.669179:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176588.669183:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176588.669191:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145579008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176588.669197:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176588.669199:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176588.669200:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669203:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669205:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176588.669209:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176588.669214:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176588.669227:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145579136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176588.669232:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145578752:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176588.669252:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176588.669256:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176588.669259:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669263:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669267:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176588.669274:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145578880:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176588.669274:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176588.669282:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176588.669294:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145579264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176588.669302:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176588.669304:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176588.669306:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669308:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669312:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176588.669317:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176588.669318:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145579008:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786176588.669320:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176588.669334:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145579392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176588.669341:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176588.669344:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176588.669345:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669348:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669351:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176588.669354:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176588.669357:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176588.669364:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145579136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176588.669369:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145579520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176588.669378:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176588.669381:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176588.669382:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176588.669385:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10322
00000100:00080000:3.0:1786176588.669388:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176588.669390:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176588.669394:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145579264:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176588.669395:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176588.669408:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145579648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176588.669421:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145579392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176588.669459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145579520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176588.669474:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145579648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176589.180997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176589.181105:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176589.693057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176590.204966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176590.205028:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176590.716977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176591.229043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176591.229115:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176591.741055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786176591.741208:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786176591.741248:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786176591.741262:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176591.741311:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176591.741340:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe66d80 x1872931145579648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176591.741341:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176591.741364:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786176591.741384:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145579648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176591.741398:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786176591.741442:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:2.0:1786176591.741445:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786176591.741454:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000800:00000100:2.0:1786176591.741464:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786176591.741469:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145579648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176591.741492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe67b80 x1872931145579136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176591.741499:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786176591.741529:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145579136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176591.741540:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786176591.741563:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176591.741571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176591.741576:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145579136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176591.741585:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe65500 x1872931145579264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176591.741611:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145579264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176591.741620:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176591.741623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176591.741627:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145579264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176591.741635:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe66a00 x1872931145579392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176591.741647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145579392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176591.741655:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176591.741659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176591.741662:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145579392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176591.741669:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe64000 x1872931145578752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176591.741682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145578752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176591.741691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176591.741695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176591.741698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145578752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176591.741708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe65f80 x1872931145578880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176591.741739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145578880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176591.741748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176591.741752:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176591.741755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145578880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176591.741763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe65180 x1872931145579008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176591.741776:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145579008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176591.741783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176591.741787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176591.741791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145579008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176591.741799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe66300 x1872931145578624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176591.741812:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145578624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176591.741820:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176591.741824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176591.741827:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145578624:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176591.741875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176588/real 1786176591]  req@ffff89d99fe64a80 x1872931145579520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176591.741891:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145579520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176591.741936:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176591.741942:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176591.741948:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145579520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176592.253055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176592.253130:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176592.764999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176593.277035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176593.277094:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176593.789083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176593.789107:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789116:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176593.789121:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176593.789132:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00080000:0.0:1786176593.789144:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176593.789152:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176593.789287:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145579776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176593.789328:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789333:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176593.789335:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176593.789340:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00080000:0.0:1786176593.789345:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176593.789350:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176593.789365:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176593.789395:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145579904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176593.789409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789415:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176593.789418:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176593.789425:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145579776:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176593.789430:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00080000:0.0:1786176593.789445:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176593.789454:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176593.789461:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176593.789481:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145580032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176593.789493:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789498:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176593.789501:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176593.789508:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00080000:0.0:1786176593.789531:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176593.789539:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176593.789551:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176593.789554:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176593.789579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145580160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176593.789592:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789597:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176593.789599:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176593.789608:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00100000:1.0:1786176593.789622:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f3100 x1872931145579776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176593.789625:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176593.789635:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176593.789648:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176593.789666:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145579776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176593.789672:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145580288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176593.789721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176593.789728:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176593.789734:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00080000:0.0:1786176593.789745:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176593.789753:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176593.789754:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176593.789765:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176593.789767:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.789781:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145579776:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176593.789791:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145580416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176593.789804:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789808:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176593.789810:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176593.789815:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00080000:0.0:1786176593.789818:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176593.789822:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176593.789828:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176593.789836:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145579904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176593.789846:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145580544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176593.789861:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176593.789869:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176593.789875:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00080000:0.0:1786176593.789883:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176593.789883:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176593.789938:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176593.789945:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176593.789962:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145580672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176593.789973:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176593.789982:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176593.789982:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f0e00 x1872931145579904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176593.789987:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176593.790002:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10328
00000100:00080000:0.0:1786176593.790012:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176593.790022:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176593.790029:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176593.790031:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145579904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176593.790054:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176593.790056:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145580800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176593.790071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.790087:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145579904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176593.790097:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145580032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176593.790127:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176593.790141:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f1500 x1872931145580032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176593.790153:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145580032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176593.790160:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176593.790164:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.790167:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145580032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176593.790173:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145580160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176593.790198:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176593.790210:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f1880 x1872931145580160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176593.790224:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145580160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176593.790234:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176593.790237:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.790243:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145580160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176593.790255:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145580288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176593.790286:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176593.790299:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f2680 x1872931145580288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176593.790310:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145580288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176593.790318:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176593.790321:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.790324:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145580288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176593.790332:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145580416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176593.790353:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176593.790365:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f2a00 x1872931145580416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176593.790376:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145580416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176593.790399:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176593.790402:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.790405:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145580416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176593.790428:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145580544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176593.790451:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176593.790464:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f2d80 x1872931145580544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176593.790478:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145580544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176593.790486:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176593.790489:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.790498:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145580544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176593.790505:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145580672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176593.790528:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176593.790541:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f0700 x1872931145580672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176593.790554:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145580672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176593.790563:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176593.790567:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.790571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145580672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176593.790578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145580800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176593.790600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176593.790612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176593/real 1786176593]  req@ffff89d9870f3b80 x1872931145580800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176593.790624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145580800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176593.790633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176593.790637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176593.790640:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145580800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176594.301049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176594.301113:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176594.813048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176595.325044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176595.325128:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176595.837003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176596.349027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176596.349213:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176596.861050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176597.372989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176597.373047:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176597.885048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176598.397009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176598.397066:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176598.909015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176598.909015:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176598.909025:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176598.909030:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176598.909042:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909052:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176598.909060:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176598.909099:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145580928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176598.909128:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176598.909132:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176598.909135:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176598.909139:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909144:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176598.909149:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176598.909158:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176598.909170:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145581056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176598.909176:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145580928:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176598.909180:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176598.909184:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176598.909186:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176598.909190:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909192:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176598.909195:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176598.909199:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176598.909207:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145581184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176598.909222:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176598.909224:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176598.909225:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176598.909228:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909231:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176598.909233:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176598.909237:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176598.909246:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176598.909248:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145581312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176598.909256:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176598.909258:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176598.909260:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176598.909263:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909265:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176598.909268:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176598.909271:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176598.909279:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145581440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176598.909285:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176598.909288:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe67100 x1872931145580928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176598.909289:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176598.909292:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176598.909298:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909303:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176598.909307:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176598.909310:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176598.909311:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145580928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176598.909323:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176598.909324:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145581568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176598.909328:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176598.909349:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145580928:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176598.909354:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176598.909358:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176598.909360:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176598.909364:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909367:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176598.909370:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176598.909374:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145581056:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176598.909375:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176598.909389:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145581696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176598.909400:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176598.909401:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176598.909406:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176598.909408:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176598.909412:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe65880 x1872931145581056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176598.909416:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909426:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176598.909430:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145581056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176598.909435:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176598.909440:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176598.909444:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176598.909445:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176598.909448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145581056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176598.909455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145581184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176598.909464:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145581824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176598.909476:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176598.909477:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176598.909483:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176598.909486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe66680 x1872931145581184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176598.909488:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176598.909498:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10333
00000100:00080000:3.0:1786176598.909507:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176598.909512:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145581184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176598.909515:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176598.909523:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176598.909530:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176598.909538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176598.909539:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145581952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176598.909547:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145581184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176598.909558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145581312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176598.909578:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176598.909587:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe67800 x1872931145581312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176598.909594:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145581312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176598.909600:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176598.909602:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176598.909604:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145581312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176598.909607:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145581440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176598.909622:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176598.909633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe67480 x1872931145581440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176598.909645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145581440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176598.909653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176598.909656:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176598.909659:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145581440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176598.909665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145581568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176598.909686:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176598.909696:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe64a80 x1872931145581568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176598.909705:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145581568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176598.909710:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176598.909712:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176598.909714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145581568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176598.909731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145581696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176598.909743:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176598.909750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe66300 x1872931145581696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176598.909757:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145581696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176598.909766:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176598.909768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176598.909770:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145581696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176598.909773:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145581824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176598.909783:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176598.909788:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe65180 x1872931145581824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176598.909795:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145581824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176598.909800:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176598.909802:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176598.909803:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145581824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176598.909807:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145581952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176598.909816:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176598.909821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176598/real 1786176598]  req@ffff89d99fe65f80 x1872931145581952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176598.909828:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145581952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176598.909833:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176598.909843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176598.909846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145581952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176599.420986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176599.421048:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176599.933004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176600.445027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176600.445085:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176600.957016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176601.469004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176601.469061:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176601.981016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176602.492986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176602.493051:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176603.005032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176603.516971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176603.517043:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176604.029062:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176604.029067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176604.029073:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176604.029083:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176604.029096:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10338
00000100:00080000:3.0:1786176604.029107:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176604.029115:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176604.029160:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145582080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176604.029185:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176604.029189:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176604.029190:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176604.029194:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10338
00000100:00080000:3.0:1786176604.029196:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176604.029198:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176604.029208:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176604.029217:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145582208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176604.029224:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176604.029226:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176604.029227:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176604.029230:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10338
00000100:00080000:3.0:1786176604.029232:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176604.029234:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176604.029237:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176604.029248:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145582336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176604.029255:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176604.029258:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176604.029260:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176604.029264:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10338
00000100:00080000:3.0:1786176604.029267:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176604.029275:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145582080:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176604.029275:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176604.029304:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176604.029321:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145582464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176604.029330:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176604.029333:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176604.029335:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176604.029339:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10338
00000100:00080000:3.0:1786176604.029342:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176604.029346:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176604.029350:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176604.029359:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145582592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176604.029365:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176604.029373:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:1.0:1786176604.029374:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176604.029380:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176604.029386:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10338
00000100:00080000:3.0:1786176604.029392:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176604.029397:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176604.029402:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176604.029414:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145582720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176604.029426:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe64000 x1872931145582080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176604.029428:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176604.029440:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176604.029447:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176604.029460:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10338
00000100:00080000:3.0:1786176604.029465:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176604.029470:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176604.029473:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145582080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176604.029477:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176604.029493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176604.029495:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145582848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176604.029500:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176604.029511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145582080:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176604.029532:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145582208:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176604.029543:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176604.029549:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176604.029551:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176604.029560:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10338
00000800:00000100:1.0:1786176604.029561:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176604.029572:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176604.029582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe66a00 x1872931145582208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176604.029593:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176604.029601:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145582208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176604.029601:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176604.029622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176604.029622:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145582976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176604.029641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176604.029651:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176604.029657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145582208:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176604.029658:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176604.029665:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176604.029674:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145582336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176604.029674:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10338
00000100:00080000:3.0:1786176604.029687:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176604.029692:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176604.029699:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176604.029706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176604.029719:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe65500 x1872931145582336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176604.029724:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145583104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176604.029742:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145582336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176604.029775:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176604.029779:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176604.029783:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145582336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176604.029818:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145582464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176604.029836:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176604.029843:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe67b80 x1872931145582464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176604.029851:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145582464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176604.029856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176604.029858:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176604.029860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145582464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176604.029864:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145582592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176604.029876:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176604.029881:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe66d80 x1872931145582592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176604.029888:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145582592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176604.029894:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176604.029925:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176604.029928:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145582592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176604.029932:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145582720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176604.029945:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176604.029953:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe64700 x1872931145582720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176604.029961:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145582720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176604.029966:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176604.029968:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176604.029970:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145582720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176604.029974:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145582848:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176604.029984:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176604.029989:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe64380 x1872931145582848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176604.029996:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145582848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176604.030001:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176604.030003:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176604.030005:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145582848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176604.030009:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145582976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176604.030018:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176604.030024:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe65f80 x1872931145582976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176604.030030:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145582976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176604.030035:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176604.030037:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176604.030039:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145582976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176604.030042:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145583104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176604.030052:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176604.030057:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176604/real 1786176604]  req@ffff89d99fe65180 x1872931145583104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176604.030064:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145583104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176604.030070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176604.030071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176604.030073:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145583104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176604.541033:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176604.541140:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176605.053053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176605.565049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176605.565149:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176606.077014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176606.589014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176606.589098:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176607.101006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176607.613015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176607.613080:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176608.125018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176608.637006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176608.637117:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176609.149020:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176609.149025:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176609.149031:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176609.149036:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176609.149045:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00080000:3.0:1786176609.149055:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176609.149062:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176609.149097:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145583232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176609.149122:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176609.149126:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176609.149129:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176609.149134:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00080000:3.0:1786176609.149138:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176609.149143:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149153:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145583232:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176609.149154:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176609.149175:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145583360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176609.149183:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176609.149186:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176609.149188:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176609.149191:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00080000:3.0:1786176609.149194:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176609.149196:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176609.149200:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176609.149209:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145583488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176609.149216:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176609.149219:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176609.149220:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176609.149222:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00080000:3.0:1786176609.149224:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176609.149229:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176609.149230:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176609.149252:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176609.149264:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145583616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176609.149271:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176609.149274:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176609.149275:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176609.149279:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00080000:3.0:1786176609.149282:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176609.149285:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176609.149289:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176609.149293:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe66300 x1872931145583232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176609.149300:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145583744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176609.149314:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145583232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176609.149331:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176609.149335:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176609.149336:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176609.149340:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176609.149345:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176609.149349:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00080000:3.0:1786176609.149356:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176609.149363:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149365:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145583232:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176609.149369:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176609.149385:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145583872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176609.149395:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145583360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176609.149399:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176609.149413:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176609.149416:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176609.149420:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00080000:3.0:1786176609.149424:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176609.149429:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176609.149432:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176609.149438:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176609.149449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe64a80 x1872931145583360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176609.149451:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145584000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176609.149478:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176609.149481:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176609.149483:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176609.149489:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00100000:1.0:1786176609.149491:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145583360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176609.149493:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176609.149498:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176609.149503:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176609.149513:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176609.149515:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145584128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176609.149523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176609.149526:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176609.149530:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176609.149531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145583360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176609.149532:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176609.149539:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10343
00000100:00080000:3.0:1786176609.149542:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176609.149547:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149548:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145583488:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176609.149550:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176609.149561:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145584256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176609.149579:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe67480 x1872931145583488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176609.149608:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145583488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176609.149622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176609.149625:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176609.149629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145583488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176609.149636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145583616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176609.149654:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149662:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe67800 x1872931145583616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176609.149670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145583616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176609.149676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176609.149678:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176609.149680:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145583616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176609.149684:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145583744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176609.149694:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe66680 x1872931145583744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176609.149707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145583744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176609.149712:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176609.149713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176609.149716:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145583744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176609.149737:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145583872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176609.149750:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe65880 x1872931145583872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176609.149764:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145583872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176609.149770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176609.149772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176609.149774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145583872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176609.149777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145584000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176609.149787:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe67100 x1872931145584000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176609.149799:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145584000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176609.149804:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176609.149806:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176609.149808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145584000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176609.149811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145584128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176609.149820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149826:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe66300 x1872931145584128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176609.149834:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145584128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176609.149839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176609.149840:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176609.149848:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145584128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176609.149852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145584256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176609.149862:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176609.149868:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176609/real 1786176609]  req@ffff89d99fe65180 x1872931145584256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176609.149876:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145584256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176609.149881:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176609.149883:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176609.149885:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145584256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176609.661010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176609.661091:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176610.173010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176610.685024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176610.685087:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176611.197004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176611.709020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176611.709078:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176612.221017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176612.732971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176612.733038:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176613.245062:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176613.756996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176613.757077:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176614.269053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176614.269072:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176614.269079:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176614.269084:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176614.269095:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269107:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176614.269115:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176614.269163:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145584384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176614.269222:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176614.269226:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176614.269228:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176614.269231:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269235:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176614.269240:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176614.269250:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176614.269263:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145584384:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176614.269264:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145584512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176614.269281:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176614.269284:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176614.269285:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176614.269288:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269291:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176614.269293:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176614.269297:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176614.269305:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145584640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176614.269312:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176614.269315:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176614.269316:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176614.269320:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269346:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176614.269349:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176614.269353:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176614.269360:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145584768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176614.269367:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176614.269373:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176614.269373:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176614.269377:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176614.269381:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269383:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176614.269386:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176614.269389:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176614.269395:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145584896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176614.269402:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176614.269405:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176614.269406:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176614.269410:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269412:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176614.269415:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176614.269418:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176614.269425:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145585024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176614.269432:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176614.269434:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2ff800 x1872931145584384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176614.269435:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176614.269438:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176614.269445:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269450:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176614.269455:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176614.269459:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176614.269467:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145584384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176614.269470:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145585152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176614.269498:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176614.269500:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176614.269501:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176614.269505:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176614.269509:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176614.269512:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269516:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176614.269518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145584384:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176614.269522:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176614.269527:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176614.269535:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145585280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176614.269541:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176614.269544:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176614.269546:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176614.269551:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145584512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176614.269551:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10348
00000100:00080000:1.0:1786176614.269557:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176614.269561:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176614.269565:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176614.269573:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145585408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176614.269583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176614.269597:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2fc700 x1872931145584512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176614.269606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145584512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176614.269621:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176614.269624:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176614.269626:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145584512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176614.269631:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145584640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176614.269644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176614.269651:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2ff480 x1872931145584640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176614.269664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145584640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176614.269669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176614.269671:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176614.269673:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145584640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176614.269676:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145584768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176614.269688:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176614.269694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2fdc00 x1872931145584768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176614.269701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145584768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176614.269706:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176614.269708:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176614.269710:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145584768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176614.269713:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145584896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176614.269723:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176614.269728:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2fe300 x1872931145584896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176614.269736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145584896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176614.269746:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176614.269748:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176614.269750:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145584896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176614.269753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145585024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176614.269763:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176614.269768:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2fe680 x1872931145585024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176614.269774:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145585024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176614.269779:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176614.269782:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176614.269784:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145585024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176614.269787:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145585152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176614.269796:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176614.269802:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2fd880 x1872931145585152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176614.269808:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145585152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176614.269813:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176614.269815:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176614.269818:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145585152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176614.269822:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145585280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176614.269832:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176614.269838:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2fce00 x1872931145585280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176614.269845:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145585280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176614.269851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176614.269852:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176614.269854:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145585280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176614.269872:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145585408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176614.269881:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176614.269887:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176614/real 1786176614]  req@ffff89d9ba2ff800 x1872931145585408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176614.269894:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145585408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176614.269918:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176614.269920:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176614.269922:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145585408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176614.781040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176614.781111:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176615.293039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176615.805047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176615.805126:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176616.317001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176616.829002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176616.829119:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176617.341005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176617.853040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176617.853113:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176618.365013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176618.876979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176618.877034:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176619.388990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176619.389052:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389057:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176619.389060:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176619.389067:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00080000:0.0:1786176619.389075:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176619.389083:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176619.389114:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145585536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176619.389145:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389150:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176619.389153:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176619.389158:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00080000:0.0:1786176619.389164:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176619.389169:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176619.389180:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176619.389185:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145585536:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176619.389201:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145585664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176619.389216:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389221:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176619.389223:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176619.389230:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00080000:0.0:1786176619.389241:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176619.389245:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176619.389250:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176619.389251:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176619.389263:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145585792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176619.389272:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389275:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176619.389276:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176619.389279:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00080000:0.0:1786176619.389282:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176619.389285:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176619.389290:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176619.389299:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f0a80 x1872931145585536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176619.389300:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145585920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176619.389326:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389331:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176619.389333:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176619.389336:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00080000:0.0:1786176619.389338:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176619.389343:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145585536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176619.389344:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176619.389352:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176619.389361:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145586048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176619.389365:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176619.389370:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389374:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176619.389375:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176619.389377:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176619.389385:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00100000:1.0:1786176619.389386:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145585536:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176619.389388:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176619.389394:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176619.389398:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176619.389404:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145586176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176619.389410:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389413:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176619.389414:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176619.389420:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00100000:1.0:1786176619.389421:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145585664:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176619.389422:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176619.389434:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176619.389437:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176619.389448:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145586304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176619.389456:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389461:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786176619.389461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176619.389466:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176619.389470:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00080000:0.0:1786176619.389474:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176619.389477:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176619.389481:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176619.389487:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f1180 x1872931145585664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176619.389491:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145586432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176619.389521:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176619.389524:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176619.389525:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176619.389530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145585664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176619.389531:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10353
00000100:00080000:0.0:1786176619.389536:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176619.389542:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176619.389549:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176619.389555:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176619.389561:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145586560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176619.389564:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176619.389576:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145585664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176619.389587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145585792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176619.389617:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176619.389634:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f3480 x1872931145585792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176619.389648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145585792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176619.389668:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176619.389671:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176619.389675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145585792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176619.389682:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145585920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176619.389704:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176619.389716:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f3b80 x1872931145585920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176619.389730:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145585920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176619.389738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176619.389741:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176619.389745:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145585920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176619.389752:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145586048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176619.389772:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176619.389786:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f0700 x1872931145586048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176619.389799:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145586048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176619.389807:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176619.389811:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176619.389814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145586048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176619.389820:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145586176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176619.389840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176619.389853:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f2d80 x1872931145586176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176619.389866:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145586176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176619.389874:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176619.389878:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176619.389881:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145586176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176619.389928:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145586304:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176619.389954:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176619.389969:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f2a00 x1872931145586304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176619.389983:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145586304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176619.389993:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176619.389997:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176619.390002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145586304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176619.390010:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145586432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176619.390033:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176619.390045:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f2680 x1872931145586432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176619.390058:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145586432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176619.390068:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176619.390072:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176619.390075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145586432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176619.390082:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145586560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176619.390103:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176619.390114:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176619/real 1786176619]  req@ffff89d9870f1880 x1872931145586560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176619.390126:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145586560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176619.390150:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176619.390154:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176619.390158:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145586560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176619.901003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176619.901077:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176620.413003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176620.924978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176620.925037:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176621.436978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176621.949001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176621.949065:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176622.460966:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176622.972979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176622.973024:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176623.484998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176623.997006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176623.997060:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176624.509050:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176624.509057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176624.509066:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176624.509071:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176624.509083:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:0.0:1786176624.509108:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176624.509117:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176624.509163:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145586688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176624.509189:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176624.509192:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176624.509194:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176624.509197:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:0.0:1786176624.509201:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176624.509205:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176624.509215:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176624.509223:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145586688:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176624.509230:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145586816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176624.509241:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176624.509244:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176624.509245:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176624.509249:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:0.0:1786176624.509251:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176624.509254:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176624.509259:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176624.509270:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145586944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176624.509278:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176624.509282:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176624.509284:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176624.509294:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176624.509298:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:0.0:1786176624.509302:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176624.509306:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176624.509313:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176624.509328:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145587072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176624.509336:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176624.509339:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176624.509341:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176624.509346:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f1500 x1872931145586688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176624.509347:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:0.0:1786176624.509357:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176624.509370:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176624.509378:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176624.509384:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145586688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176624.509392:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145587200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176624.509438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176624.509439:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176624.509455:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176624.509461:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176624.509462:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176624.509471:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145586688:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176624.509472:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:0.0:1786176624.509487:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176624.509492:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176624.509497:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176624.509507:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145587328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176624.509513:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145586816:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176624.509544:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176624.509548:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176624.509549:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176624.509554:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:0.0:1786176624.509556:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176624.509560:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176624.509565:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176624.509571:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176624.509580:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f0e00 x1872931145586816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176624.509596:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145587456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176624.509613:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145586816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176624.509614:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176624.509630:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176624.509637:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176624.509657:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:1.0:1786176624.509658:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176624.509673:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176624.509675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176624.509685:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176624.509687:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145586816:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176624.509696:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176624.509702:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145586944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176624.509711:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145587584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176624.509724:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176624.509735:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1786176624.509736:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176624.509738:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176624.509747:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10358
00000100:00080000:0.0:1786176624.509752:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176624.509756:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176624.509759:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176624.509771:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f3100 x1872931145586944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176624.509773:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145587712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176624.509837:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145586944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176624.509847:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176624.509851:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176624.509858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145586944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176624.509866:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145587072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176624.509889:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176624.509931:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f1880 x1872931145587072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176624.509944:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145587072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176624.509952:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176624.509955:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176624.509958:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145587072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176624.509972:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145587200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176624.509991:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176624.510001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f2680 x1872931145587200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176624.510018:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145587200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176624.510026:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176624.510029:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176624.510032:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145587200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176624.510049:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145587328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176624.510067:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176624.510078:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f2a00 x1872931145587328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176624.510105:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145587328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176624.510113:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176624.510116:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176624.510119:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145587328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176624.510125:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145587456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176624.510144:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176624.510155:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f2d80 x1872931145587456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176624.510166:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145587456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176624.510179:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176624.510182:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176624.510185:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145587456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176624.510191:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145587584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176624.510210:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176624.510222:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f0700 x1872931145587584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176624.510233:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145587584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176624.510239:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176624.510242:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176624.510244:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145587584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176624.510248:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145587712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176624.510262:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176624.510269:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176624/real 1786176624]  req@ffff89d9870f3b80 x1872931145587712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176624.510277:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145587712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176624.510282:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176624.510284:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176624.510286:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145587712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176625.021009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176625.021074:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176625.532985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176626.045029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176626.045144:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176626.557003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176627.069014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176627.069119:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176627.580968:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176628.093002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176628.093085:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176628.604994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176629.117006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176629.117077:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176629.628968:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176629.628968:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176629.628979:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176629.628984:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176629.628995:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:0.0:1786176629.629005:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176629.629013:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176629.629061:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145587840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176629.629084:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176629.629087:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176629.629088:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176629.629091:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:0.0:1786176629.629094:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176629.629097:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176629.629106:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176629.629120:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145587968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176629.629124:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145587840:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176629.629141:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176629.629145:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176629.629148:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176629.629153:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:0.0:1786176629.629158:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176629.629161:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176629.629166:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176629.629176:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145588096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176629.629183:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176629.629186:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176629.629187:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176629.629193:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176629.629195:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:0.0:1786176629.629200:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176629.629203:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176629.629207:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176629.629222:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145588224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176629.629231:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f3480 x1872931145587840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176629.629236:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176629.629246:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176629.629250:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176629.629255:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145587840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176629.629256:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:0.0:1786176629.629263:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176629.629268:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176629.629269:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786176629.629275:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176629.629275:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176629.629283:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145587840:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176629.629291:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145588352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176629.629299:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176629.629301:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176629.629302:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176629.629305:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145587968:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176629.629309:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:0.0:1786176629.629313:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176629.629316:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176629.629319:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176629.629328:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145588480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176629.629333:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176629.629343:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176629.629347:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176629.629348:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f1180 x1872931145587968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176629.629349:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176629.629357:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:0.0:1786176629.629363:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176629.629371:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145587968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176629.629375:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176629.629381:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176629.629385:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176629.629390:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176629.629394:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145588608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176629.629397:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145587968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176629.629410:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145588096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176629.629412:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176629.629416:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176629.629417:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176629.629421:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:0.0:1786176629.629426:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176629.629429:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176629.629432:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176629.629438:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176629.629443:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f0a80 x1872931145588096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176629.629448:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145588736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176629.629461:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176629.629461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145588096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176629.629469:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176629.629472:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176629.629479:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10363
00000100:00080000:1.0:1786176629.629480:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176629.629482:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176629.629486:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176629.629490:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176629.629495:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176629.629503:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145588864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176629.629504:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145588096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176629.629518:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145588224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176629.629536:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176629.629544:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f3b80 x1872931145588224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176629.629552:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145588224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176629.629557:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176629.629559:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176629.629562:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145588224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176629.629565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145588352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176629.629575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176629.629582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f0700 x1872931145588352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176629.629589:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145588352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176629.629594:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176629.629596:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176629.629598:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145588352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176629.629609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145588480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176629.629620:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176629.629625:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f2d80 x1872931145588480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176629.629632:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145588480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176629.629637:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176629.629639:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176629.629641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145588480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176629.629644:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145588608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176629.629654:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176629.629659:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f2a00 x1872931145588608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176629.629666:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145588608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176629.629672:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176629.629674:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176629.629676:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145588608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176629.629679:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145588736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176629.629688:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176629.629693:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f2680 x1872931145588736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176629.629699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145588736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176629.629704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176629.629706:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176629.629708:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145588736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176629.629712:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145588864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176629.629721:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176629.629726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176629/real 1786176629]  req@ffff89d9870f1880 x1872931145588864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176629.629733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145588864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176629.629738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176629.629739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176629.629742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145588864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176630.141014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176630.141082:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176630.652990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176631.165007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176631.165070:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176631.676979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176632.189103:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176632.189150:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176632.701052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176633.213050:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176633.213123:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176633.725021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176634.236968:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176634.237076:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176634.749022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176634.749026:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176634.749034:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176634.749038:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176634.749049:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749067:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176634.749076:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176634.749112:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145588992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176634.749136:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176634.749139:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176634.749140:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176634.749143:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749147:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176634.749150:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176634.749158:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176634.749163:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145588992:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176634.749170:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145589120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176634.749178:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176634.749181:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176634.749182:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176634.749185:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749188:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176634.749190:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176634.749194:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176634.749205:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145589248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176634.749215:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176634.749219:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:0.0:1786176634.749222:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176634.749223:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176634.749231:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749236:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176634.749241:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176634.749247:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176634.749259:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2fd500 x1872931145588992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176634.749270:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145589376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176634.749280:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176634.749282:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786176634.749284:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145588992/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176634.749285:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176634.749293:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749300:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176634.749304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176634.749305:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176634.749313:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786176634.749313:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176634.749321:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145588992:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176634.749326:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145589504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176634.749337:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176634.749340:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786176634.749342:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145589120:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176634.749343:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176634.749356:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749363:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176634.749366:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176634.749370:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786176634.749374:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176634.749381:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145589632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176634.749390:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176634.749392:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2fc380 x1872931145589120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176634.749393:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176634.749396:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176634.749404:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749410:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176634.749413:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145589120/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176634.749414:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176634.749424:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786176634.749435:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176634.749441:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176634.749442:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145589760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176634.749444:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145589120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176634.749454:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145589248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176634.749468:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176634.749471:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176634.749473:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786176634.749477:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176634.749480:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749487:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176634.749491:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2fdf80 x1872931145589248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176634.749494:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176634.749502:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176634.749508:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145589248/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176634.749516:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176634.749516:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145589888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176634.749523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176634.749531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145589248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176634.749533:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176634.749537:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786176634.749539:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145589376:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786176634.749540:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176634.749548:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10368
00000100:00080000:1.0:1786176634.749550:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176634.749552:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176634.749555:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176634.749568:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145590016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176634.749571:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176634.749583:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2ffb80 x1872931145589376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176634.749593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145589376/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176634.749599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176634.749603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176634.749606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145589376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176634.749611:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145589504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176634.749621:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176634.749627:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2ff100 x1872931145589504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176634.749634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145589504/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176634.749644:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176634.749646:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176634.749648:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145589504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176634.749661:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145589632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176634.749672:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176634.749678:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2fd180 x1872931145589632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176634.749686:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145589632/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176634.749694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176634.749698:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176634.749702:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145589632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176634.749708:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145589760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176634.749726:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176634.749739:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2fed80 x1872931145589760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176634.749750:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145589760/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176634.749758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176634.749761:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176634.749765:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145589760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176634.749771:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145589888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176634.749790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176634.749802:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2fea00 x1872931145589888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176634.749814:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145589888/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176634.749823:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176634.749826:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176634.749830:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145589888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176634.749836:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145590016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176634.749855:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176634.749866:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176634/real 1786176634]  req@ffff89d9ba2fd500 x1872931145590016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176634.749879:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145590016/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176634.749889:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176634.749892:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176634.749916:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145590016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176635.260976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176635.261046:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176635.773006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176636.284994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176636.285074:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176636.797053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176637.309085:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176637.309240:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176637.821015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176638.332998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176638.333043:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176638.844992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176639.357048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176639.357128:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176639.869028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176639.869038:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176639.869043:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176639.869048:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176639.869057:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869065:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176639.869072:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176639.869106:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145590144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176639.869129:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176639.869132:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176639.869133:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176639.869136:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869138:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176639.869141:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176639.869148:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176639.869158:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145590144:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176639.869159:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145590272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176639.869173:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176639.869175:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176639.869177:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176639.869180:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869183:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176639.869185:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176639.869188:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176639.869198:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145590400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176639.869204:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176639.869207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176639.869208:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176639.869211:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869214:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176639.869215:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176639.869220:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176639.869224:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176639.869232:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145590528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176639.869240:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176639.869242:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176639.869244:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176639.869246:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869248:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176639.869250:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176639.869253:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176639.869260:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145590656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176639.869266:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176639.869269:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176639.869272:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176639.869274:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87c700 x1872931145590144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176639.869276:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869279:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176639.869286:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176639.869293:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176639.869301:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145590784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176639.869307:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176639.869309:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145590144/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176639.869311:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176639.869315:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176639.869323:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869328:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176639.869329:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176639.869331:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176639.869335:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786176639.869336:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869342:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145590144:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176639.869347:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145590912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176639.869354:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176639.869356:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176639.869357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176639.869361:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869364:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176639.869367:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145590272:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176639.869370:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176639.869376:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176639.869385:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145591040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176639.869392:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176639.869396:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176639.869405:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176639.869407:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176639.869408:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87d880 x1872931145590272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176639.869414:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10374
00000100:00080000:2.0:1786176639.869420:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176639.869426:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176639.869429:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145590272/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176639.869431:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176639.869440:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786176639.869445:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145591168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176639.869447:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869454:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145590272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176639.869465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145590400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176639.869480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176639.869487:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87f800 x1872931145590400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176639.869495:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145590400/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176639.869500:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176639.869502:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869504:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145590400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176639.869508:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145590528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176639.869518:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176639.869523:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87ed80 x1872931145590528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176639.869530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145590528/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176639.869536:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176639.869538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869540:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145590528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176639.869543:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145590656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176639.869552:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176639.869557:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87ca80 x1872931145590656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176639.869564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145590656/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176639.869569:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176639.869571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869572:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145590656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176639.869576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145590784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176639.869585:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176639.869590:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87dc00 x1872931145590784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176639.869596:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145590784/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176639.869601:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176639.869603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145590784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176639.869609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145590912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176639.869625:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176639.869636:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87e680 x1872931145590912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176639.869648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145590912/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176639.869656:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176639.869660:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869663:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145590912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176639.869677:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145591040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176639.869692:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176639.869700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87df80 x1872931145591040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176639.869708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145591040/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176639.869713:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176639.869715:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869717:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145591040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176639.869720:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145591168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176639.869729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176639.869735:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176639/real 1786176639]  req@ffff89d99e87c380 x1872931145591168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176639.869742:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145591168/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176639.869747:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176639.869749:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176639.869751:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145591168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176640.381009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176640.381084:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176640.893030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176641.405036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176641.405095:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176641.917086:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176642.429000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176642.429075:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176642.940987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176643.453081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176643.453136:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176643.965031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176644.477008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176644.477053:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176644.989023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176644.989077:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989085:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176644.989089:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176644.989098:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989107:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989113:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176644.989146:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145591296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176644.989172:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989174:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176644.989176:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176644.989179:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989181:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989183:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176644.989191:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176644.989199:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145591424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176644.989209:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989211:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176644.989212:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176644.989220:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145591296:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176644.989220:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989232:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989240:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176644.989243:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176644.989257:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145591552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176644.989268:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989281:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176644.989283:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176644.989285:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989287:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989289:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176644.989292:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176644.989304:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145591680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176644.989310:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989312:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176644.989314:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176644.989316:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989320:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989322:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176644.989327:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176644.989335:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145591808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176644.989343:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989346:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176644.989348:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176644.989350:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989353:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989356:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176644.989359:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786176644.989384:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176644.989389:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145591936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176644.989398:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989401:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176644.989402:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176644.989405:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989420:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989423:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176644.989426:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176644.989435:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145592064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176644.989442:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989444:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176644.989445:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176644.989447:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989450:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989453:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176644.989457:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176644.989462:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145592192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176644.989472:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176644.989475:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176644.989476:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176644.989483:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe65f80 x1872931145591296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176644.989484:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10379
00000100:00080000:3.0:1786176644.989494:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176644.989510:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176644.989518:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176644.989527:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145592320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176644.989531:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145591296/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.989585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.989590:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.989596:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145591296:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176644.989629:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145591424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176644.989657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176644.989669:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe64380 x1872931145591424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176644.989680:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145591424/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.989687:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.989690:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.989693:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145591424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176644.989698:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145591552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176644.989712:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176644.989744:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe64700 x1872931145591552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176644.989753:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145591552/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.989760:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.989762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.989764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145591552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176644.989768:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145591680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176644.989782:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176644.989789:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe66d80 x1872931145591680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176644.989804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145591680/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.989810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.989813:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.989815:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145591680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176644.989819:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145591808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176644.989831:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176644.989854:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe67b80 x1872931145591808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176644.989865:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145591808/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.989872:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.989875:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.989877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145591808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176644.989882:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145591936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176644.989973:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176644.989983:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe65500 x1872931145591936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176644.989992:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145591936/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.990004:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.990006:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.990009:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145591936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176644.990014:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145592064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176644.990028:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176644.990035:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe66a00 x1872931145592064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176644.990044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145592064/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.990050:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.990052:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.990054:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145592064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176644.990059:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145592192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176644.990071:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176644.990078:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe64000 x1872931145592192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176644.990086:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145592192/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.990092:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.990094:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.990098:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145592192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176644.990103:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145592320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176644.990115:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176644.990122:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176644/real 1786176644]  req@ffff89d99fe65180 x1872931145592320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176644.990131:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145592320/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176669 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176644.990137:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176644.990139:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176644.990141:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145592320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176645.500991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176645.501054:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176646.013035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176646.525026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176646.525105:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176647.036979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176647.549046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176647.549125:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176648.061056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176648.573020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176648.573078:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176649.084961:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176649.597022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176649.597077:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176650.109015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176650.109028:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176650.109034:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176650.109038:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176650.109046:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00080000:2.0:1786176650.109053:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109059:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176650.109097:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145592448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176650.109127:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176650.109131:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176650.109132:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176650.109136:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00080000:2.0:1786176650.109139:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109143:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109157:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145592448:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176650.109159:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176650.109176:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145592576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176650.109185:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176650.109187:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176650.109189:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176650.109192:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00080000:2.0:1786176650.109195:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109198:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176650.109201:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176650.109209:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145592704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176650.109216:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176650.109219:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176650.109222:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786176650.109223:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176650.109227:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00080000:2.0:1786176650.109230:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109233:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176650.109237:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176650.109247:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145592832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176650.109253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176650.109256:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176650.109257:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176650.109260:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00080000:2.0:1786176650.109262:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109263:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109273:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87d500 x1872931145592448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176650.109274:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176650.109287:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145592960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176650.109295:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176650.109298:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176650.109299:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176650.109303:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00100000:0.0:1786176650.109304:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145592448/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176650.109306:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109312:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176650.109319:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786176650.109325:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786176650.109329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145593088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176650.109333:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176650.109341:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145592448:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176650.109345:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176650.109348:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176650.109351:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176650.109354:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00080000:2.0:1786176650.109357:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109359:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176650.109362:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176650.109367:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145592576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176650.109372:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145593216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176650.109380:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176650.109383:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176650.109385:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176650.109387:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00080000:2.0:1786176650.109390:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109395:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786176650.109396:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176650.109400:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176650.109411:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87c000 x1872931145592576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176650.109415:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145593344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176650.109431:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145592576/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176650.109436:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176650.109443:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176650.109444:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176650.109450:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176650.109451:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176650.109457:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145592576:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176650.109462:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10384
00000100:00100000:0.0:1786176650.109467:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145592704:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176650.109468:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176650.109476:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176650.109483:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176650.109486:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109497:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87f100 x1872931145592704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176650.109505:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145593472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176650.109511:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145592704/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176650.109533:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176650.109537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176650.109539:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145592704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176650.109544:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145592832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176650.109557:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109563:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87c380 x1872931145592832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176650.109570:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145592832/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176650.109575:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176650.109577:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176650.109579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145592832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176650.109582:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145592960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176650.109592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109597:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87df80 x1872931145592960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176650.109604:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145592960/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176650.109609:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176650.109611:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176650.109613:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145592960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176650.109616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145593088:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176650.109625:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109630:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87e680 x1872931145593088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176650.109637:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145593088/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176650.109647:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176650.109649:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176650.109651:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145593088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176650.109666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145593216:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176650.109683:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109695:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87dc00 x1872931145593216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176650.109708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145593216/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176650.109717:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176650.109720:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176650.109722:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145593216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176650.109727:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145593344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176650.109741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87ca80 x1872931145593344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176650.109756:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145593344/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176650.109762:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176650.109764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176650.109766:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145593344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176650.109770:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145593472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176650.109779:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176650.109785:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176650/real 1786176650]  req@ffff89d99e87ed80 x1872931145593472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176650.109792:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145593472/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176650.109797:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176650.109799:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176650.109801:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145593472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176650.621018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176650.621090:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176651.132980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176651.645010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176651.645068:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176652.156984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176652.669002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176652.669071:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176653.181022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176653.692999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176653.693044:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176654.205016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176654.717004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176654.717146:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176655.229077:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176655.229086:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229097:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176655.229102:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176655.229114:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229124:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229136:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176655.229181:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145593600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176655.229207:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229212:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176655.229214:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176655.229223:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229229:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229236:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176655.229246:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145593600:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176655.229250:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176655.229276:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145593728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176655.229301:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229307:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176655.229313:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176655.229324:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229330:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229339:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176655.229347:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176655.229365:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145593856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176655.229375:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145593728:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176655.229381:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229387:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176655.229389:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176655.229415:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229420:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229426:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176655.229438:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176655.229461:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145593984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176655.229477:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229482:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176655.229486:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176655.229492:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229499:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229507:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176655.229515:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176655.229554:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145594112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176655.229566:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229571:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176655.229574:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176655.229579:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229584:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229591:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176655.229597:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176655.229613:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145594240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176655.229626:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229631:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176655.229634:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176655.229641:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229648:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229654:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176655.229661:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176655.229680:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145594368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176655.229694:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229699:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176655.229702:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176655.229709:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229714:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229721:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176655.229727:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145593856:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176655.229732:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176655.229774:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145594496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176655.229814:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176655.229820:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176655.229823:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176655.229827:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145593984:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176655.229832:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10389
00000100:00080000:2.0:1786176655.229840:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176655.229849:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176655.229856:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176655.229872:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145594624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176655.229894:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145594112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176655.229984:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145594240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176655.230015:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145594368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176655.230061:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145594496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176655.230103:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145594624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176655.740984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176655.741090:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176656.252993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176656.765014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176656.765092:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176657.276974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176657.788998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176657.789056:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176658.301018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786176658.301361:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786176658.301422:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786176658.301436:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176658.301482:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786176658.301493:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176658.301500:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176658.301507:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176658.301516:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176658.301525:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176658.301535:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176658.301543:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176658.301555:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87c380 x1872931145594624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.301597:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145594624/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.301612:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.301618:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.301623:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145594624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176658.301649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87c700 x1872931145593856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.301668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145593856/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.301678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.301683:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.301688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145593856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176658.301697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87ed80 x1872931145593984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.301713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145593984/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.301724:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.301730:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.301734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145593984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176658.301742:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87ca80 x1872931145594112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.301800:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145594112/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.301810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.301815:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.301819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145594112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176658.301827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87dc00 x1872931145594240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.301842:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145594240/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.301851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.301856:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.301861:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145594240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176658.301869:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87e680 x1872931145594368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.301885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145594368/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.301931:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.301937:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.301942:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145594368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176658.301952:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87d880 x1872931145593728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.301968:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145593728/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.301977:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.301981:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.301985:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145593728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176658.302006:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87f800 x1872931145593600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.302025:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145593600/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.302036:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.302042:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.302047:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145593600:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176658.302084:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176655/real 1786176658]  req@ffff89d99e87df80 x1872931145594496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176658.302100:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145594496/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176658.302111:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176658.302115:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176658.303260:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145594496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176658.813061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176658.813127:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176659.325033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176659.836976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176659.837026:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176660.349007:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176660.349009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176660.349035:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176660.349040:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349066:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10394
00000100:00080000:2.0:1786176660.349079:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176660.349088:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176660.349152:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145594752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176660.349178:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176660.349181:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176660.349183:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349191:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10394
00000100:00080000:2.0:1786176660.349195:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176660.349198:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176660.349209:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176660.349219:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145594880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176660.349227:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176660.349230:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176660.349232:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349238:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10394
00000100:00080000:2.0:1786176660.349240:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176660.349243:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176660.349248:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176660.349256:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145595008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176660.349264:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176660.349267:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176660.349268:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349273:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10394
00000100:00080000:2.0:1786176660.349276:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176660.349282:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176660.349299:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176660.349304:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145594752:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176660.349309:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145595136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176660.349333:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176660.349337:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176660.349338:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349340:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10394
00000100:00080000:2.0:1786176660.349342:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176660.349347:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176660.349352:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176660.349374:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145595264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176660.349383:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176660.349387:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176660.349390:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349395:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10394
00000100:00080000:2.0:1786176660.349414:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176660.349420:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176660.349426:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176660.349431:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176660.349458:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145595392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176660.349471:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176660.349475:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176660.349477:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349482:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10394
00000100:00080000:2.0:1786176660.349487:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176660.349493:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176660.349500:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176660.349513:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145595520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176660.349526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87f100 x1872931145594752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176660.349534:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176660.349548:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176660.349554:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349568:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10394
00000100:00080000:2.0:1786176660.349574:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176660.349576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145594752/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176660.349586:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176660.349602:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176660.349607:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.349616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176660.349623:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145595648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176660.349626:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145594752:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176660.349656:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145594880:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176660.349676:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176660.349680:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176660.349683:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176660.349690:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10394
00000800:00000100:3.0:1786176660.349697:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176660.349701:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176660.349711:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176660.349719:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176660.349732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87c000 x1872931145594880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176660.349755:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145595776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176660.349771:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145594880/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176660.349784:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.349789:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176660.349793:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145594880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176660.349825:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145595008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176660.349850:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176660.349863:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87d500 x1872931145595008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176660.349875:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145595008/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176660.349883:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.349886:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176660.349889:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145595008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176660.350307:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145595136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176660.350338:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176660.350353:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87df80 x1872931145595136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176660.350366:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145595136/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176660.350375:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.350379:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176660.350383:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145595136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176660.350391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145595264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176660.350414:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176660.350426:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87f800 x1872931145595264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176660.350439:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145595264/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176660.350448:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.350451:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176660.350455:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145595264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176660.350462:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145595392:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176660.350486:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176660.350499:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87d880 x1872931145595392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176660.350512:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145595392/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176660.350521:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.350524:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176660.350528:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145595392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176660.350535:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145595520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176660.350557:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176660.350566:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87e680 x1872931145595520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176660.350574:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145595520/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176660.350579:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.350581:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176660.350584:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145595520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176660.350591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145595648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176660.350610:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176660.350621:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87dc00 x1872931145595648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176660.350633:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145595648/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176660.350643:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.350647:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176660.350653:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145595648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176660.350659:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145595776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176660.350684:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176660.350698:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176660/real 1786176660]  req@ffff89d99e87ca80 x1872931145595776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176660.350707:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145595776/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176660.350714:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176660.350718:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176660.350724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145595776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176660.861097:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176660.861184:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176661.373003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176661.885023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176661.885036:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176662.396975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176662.909021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176662.909100:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176663.421067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176663.933012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176663.933138:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176664.444975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176664.957007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176664.957114:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176665.469027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176665.469038:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469048:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176665.469053:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176665.469065:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00080000:2.0:1786176665.469077:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176665.469085:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176665.469131:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145595904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176665.469163:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469166:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176665.469168:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176665.469171:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00080000:2.0:1786176665.469173:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176665.469176:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176665.469187:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176665.469197:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145596032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176665.469207:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469210:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176665.469211:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176665.469217:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00100000:3.0:1786176665.469218:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145595904:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176665.469219:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176665.469226:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176665.469232:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176665.469242:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145596160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176665.469248:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469251:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176665.469253:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176665.469255:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00080000:2.0:1786176665.469258:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176665.469260:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176665.469263:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176665.469273:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145596288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176665.469279:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469281:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176665.469283:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176665.469292:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00080000:2.0:1786176665.469295:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176665.469298:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176665.469302:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176665.469307:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176665.469314:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145596416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176665.469322:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469325:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176665.469326:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176665.469330:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00080000:2.0:1786176665.469332:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176665.469335:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176665.469338:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176665.469346:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145596544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176665.469352:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469355:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176665.469357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176665.469362:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00100000:3.0:1786176665.469363:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87ed80 x1872931145595904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176665.469364:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176665.469371:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176665.469378:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176665.469389:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145596672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176665.469391:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145595904/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176665.469406:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469410:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176665.469412:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176665.469412:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176665.469420:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00080000:3.0:1786176665.469421:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176665.469426:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176665.469429:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145595904:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176665.469433:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176665.469438:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176665.469446:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145596800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176665.469452:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176665.469455:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176665.469458:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176665.469459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145596032:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176665.469464:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10399
00000100:00080000:2.0:1786176665.469467:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176665.469471:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176665.469474:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176665.469483:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145596928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176665.469489:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176665.469507:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87c700 x1872931145596032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176665.469517:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145596032/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176665.469524:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176665.469528:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176665.469532:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145596032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176665.469538:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145596160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176665.469559:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176665.469571:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87c380 x1872931145596160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176665.469585:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145596160/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176665.469591:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176665.469594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176665.469596:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145596160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176665.469601:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145596288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176665.469618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176665.469625:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87ca80 x1872931145596288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176665.469633:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145596288/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176665.469639:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176665.469641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176665.469643:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145596288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176665.469647:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145596416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176665.469657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176665.469662:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87dc00 x1872931145596416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176665.469669:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145596416/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176665.469674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176665.469676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176665.469678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145596416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176665.469681:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145596544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176665.469722:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176665.469731:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87e680 x1872931145596544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176665.469739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145596544/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176665.469748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176665.469751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176665.469755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145596544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176665.469762:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145596672:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176665.469783:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176665.469796:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87d880 x1872931145596672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176665.469804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145596672/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176665.469810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176665.469812:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176665.469814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145596672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176665.469818:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145596800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176665.469832:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176665.469839:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87f800 x1872931145596800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176665.469846:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145596800/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176665.469852:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176665.469853:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176665.469855:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145596800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176665.469870:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145596928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176665.469880:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176665.469887:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176665/real 1786176665]  req@ffff89d99e87df80 x1872931145596928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176665.469895:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145596928/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176665.469924:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176665.469927:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176665.469929:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145596928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176665.981021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176665.981106:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176666.492985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176667.005057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176667.005165:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176667.517034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176668.029028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176668.029126:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176668.541024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176669.053020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176669.053112:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176669.565039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176670.077039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176670.077113:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176670.588991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176670.589024:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589030:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176670.589034:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176670.589044:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589054:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589061:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176670.589101:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145597056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176670.589138:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589150:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176670.589153:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176670.589158:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589162:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589166:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176670.589175:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176670.589181:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145597056:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176670.589190:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145597184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176670.589199:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589202:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176670.589203:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176670.589206:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589209:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589211:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176670.589214:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176670.589222:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145597312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176670.589229:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589232:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176670.589233:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176670.589236:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589239:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589241:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176670.589244:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176670.589248:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176670.589255:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145597440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176670.589263:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589266:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176670.589268:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176670.589271:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589272:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589275:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176670.589278:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176670.589285:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145597568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176670.589291:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589295:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786176670.589296:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2ff800 x1872931145597056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176670.589297:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176670.589303:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589308:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589313:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176670.589321:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176670.589329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145597696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176670.589335:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145597056/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176670.589356:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589362:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176670.589363:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176670.589366:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176670.589367:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589372:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589377:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176670.589377:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786176670.589385:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176670.589389:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145597056:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176670.589396:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145597824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176670.589408:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589411:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176670.589413:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176670.589418:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145597184:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176670.589420:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589429:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589434:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176670.589440:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176670.589455:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145597952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176670.589461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176670.589463:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176670.589468:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176670.589470:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176670.589473:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10404
00000100:00080000:1.0:1786176670.589477:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176670.589481:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176670.589486:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2fce00 x1872931145597184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176670.589487:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176670.589499:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145598080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176670.589509:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145597184/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176670.589520:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176670.589524:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176670.589529:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145597184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176670.589535:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145597312:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176670.589553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176670.589561:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2fd880 x1872931145597312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176670.589569:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145597312/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176670.589575:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176670.589577:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176670.589579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145597312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176670.589583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145597440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176670.589593:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176670.589599:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2fe680 x1872931145597440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176670.589606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145597440/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176670.589613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176670.589616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176670.589620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145597440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176670.589626:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145597568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176670.589661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176670.589674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2fe300 x1872931145597568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176670.589687:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145597568/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176670.589696:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176670.589699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176670.589710:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145597568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176670.589717:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145597696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176670.589737:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176670.589749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2fdc00 x1872931145597696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176670.589759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145597696/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176670.589766:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176670.589769:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176670.589773:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145597696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176670.589780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145597824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176670.589800:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176670.589810:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2ff480 x1872931145597824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176670.589822:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145597824/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176670.589832:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176670.589835:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176670.589839:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145597824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176670.589860:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145597952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176670.589880:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176670.589891:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2fc700 x1872931145597952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176670.589926:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145597952/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176670.589935:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176670.589938:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176670.589941:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145597952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176670.589948:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145598080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176670.589966:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176670.589977:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176670/real 1786176670]  req@ffff89d9ba2ff800 x1872931145598080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176670.589988:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145598080/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176670.589996:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176670.589999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176670.590002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145598080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176671.101022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176671.101096:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176671.612999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176672.125029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176672.125094:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176672.637016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176673.149058:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176673.149138:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176673.660987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176674.173003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176674.173076:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176674.684997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176675.196976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176675.197015:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786176675.709043:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176675.709054:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176675.709060:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176675.709073:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00080000:1.0:1786176675.709088:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176675.709096:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176675.709100:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176675.709157:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145598208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176675.709184:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176675.709188:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176675.709189:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176675.709192:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00080000:1.0:1786176675.709197:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176675.709201:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176675.709212:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176675.709225:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145598336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176675.709225:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145598208:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176675.709249:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176675.709251:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176675.709252:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176675.709258:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00080000:1.0:1786176675.709260:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176675.709262:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176675.709266:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176675.709279:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145598464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176675.709286:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176675.709289:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176675.709291:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176675.709296:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00080000:1.0:1786176675.709298:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176675.709301:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176675.709305:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176675.709305:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176675.709319:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145598592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176675.709329:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176675.709332:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176675.709333:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176675.709338:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00080000:1.0:1786176675.709344:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176675.709348:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176675.709352:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176675.709358:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2fd500 x1872931145598208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176675.709364:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145598720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176675.709404:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176675.709407:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1786176675.709409:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145598208/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176675.709413:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176675.709431:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00080000:3.0:1786176675.709431:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176675.709439:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176675.709440:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176675.709446:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145598208:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176675.709455:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176675.709464:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176675.709478:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145598336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176675.709479:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145598848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176675.709504:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176675.709508:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176675.709511:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786176675.709520:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176675.709524:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00100000:3.0:1786176675.709535:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2fea00 x1872931145598336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176675.709538:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176675.709551:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176675.709556:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176675.709559:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145598336/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176675.709571:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176675.709579:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145598976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176675.709580:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176675.709609:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176675.709609:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145598336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176675.709627:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176675.709630:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176675.709635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145598464:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176675.709642:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00080000:1.0:1786176675.709649:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176675.709656:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:3.0:1786176675.709663:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786176675.709664:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176675.709675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2fed80 x1872931145598464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176675.709687:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145599104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176675.709688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145598464/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176675.709750:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176675.709752:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176675.709755:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176675.709763:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176675.709765:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176675.709770:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145598464:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176675.709773:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10409
00000100:00080000:1.0:1786176675.709782:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176675.709788:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176675.709793:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145598592:192.168.202.130@tcp:8:kworker.0
00000008:00100000:1.0:1786176675.709795:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176675.709818:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145599232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176675.709842:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176675.709856:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2fd180 x1872931145598592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176675.709864:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145598592/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176675.709871:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176675.709873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176675.709876:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145598592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176675.709880:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145598720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176675.709893:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176675.709920:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2ff100 x1872931145598720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176675.709928:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145598720/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176675.709934:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176675.709936:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176675.709938:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145598720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176675.709954:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145598848:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176675.709967:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176675.709974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2ffb80 x1872931145598848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176675.709982:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145598848/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176675.709987:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176675.709989:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176675.709992:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145598848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176675.709996:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145598976:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176675.710006:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176675.710012:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2fdf80 x1872931145598976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176675.710019:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145598976/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176675.710024:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176675.710025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176675.710027:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145598976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176675.710031:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145599104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176675.710040:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176675.710045:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2fc380 x1872931145599104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176675.710060:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145599104/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176675.710066:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176675.710068:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176675.710070:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145599104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176675.710074:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145599232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176675.710085:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176675.710092:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176675/real 1786176675]  req@ffff89d9ba2fd500 x1872931145599232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176675.710099:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145599232/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176675.710104:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176675.710106:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176675.710108:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145599232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176676.221057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176676.221135:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176676.733066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176677.244985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176677.245089:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176677.757040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176678.269013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176678.269113:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176678.781027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176679.292995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176679.293101:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176679.805034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176680.316968:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176680.317044:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176680.829007:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176680.829011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176680.829017:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176680.829022:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176680.829030:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829040:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829047:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176680.829082:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145599360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176680.829104:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176680.829108:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176680.829109:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176680.829112:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829114:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829118:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176680.829125:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176680.829140:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145599488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176680.829144:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145599360:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176680.829155:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176680.829158:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176680.829160:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176680.829163:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829166:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829168:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176680.829171:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176680.829180:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145599616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176680.829187:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176680.829190:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176680.829191:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176680.829193:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829196:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829198:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176680.829201:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176680.829207:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145599744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176680.829213:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176680.829218:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176680.829219:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176680.829223:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176680.829226:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829229:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829232:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176680.829235:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176680.829243:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145599872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176680.829249:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176680.829251:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176680.829253:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176680.829256:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829257:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829260:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176680.829263:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176680.829267:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe66300 x1872931145599360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176680.829275:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145600000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176680.829285:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176680.829288:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176680.829289:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176680.829293:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145599360/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176680.829295:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829301:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829308:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176680.829315:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786176680.829318:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176680.829323:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145600128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176680.829328:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829337:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145599360:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176680.829343:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176680.829347:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176680.829349:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176680.829353:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829355:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829357:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176680.829360:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176680.829369:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145599488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176680.829370:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145600256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176680.829383:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176680.829386:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176680.829387:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176680.829390:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10415
00000100:00080000:3.0:1786176680.829391:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176680.829394:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176680.829398:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176680.829408:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176680.829409:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145600384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176680.829431:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe67100 x1872931145599488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176680.829444:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145599488/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176680.829453:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176680.829456:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829459:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145599488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176680.829465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145599616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176680.829485:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176680.829496:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe65880 x1872931145599616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176680.829507:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145599616/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176680.829515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176680.829518:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829521:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145599616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176680.829527:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145599744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176680.829582:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176680.829595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe66680 x1872931145599744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176680.829605:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145599744/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176680.829611:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176680.829613:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829615:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145599744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176680.829621:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145599872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176680.829641:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176680.829653:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe67800 x1872931145599872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176680.829666:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145599872/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176680.829675:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176680.829678:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829681:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145599872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176680.829687:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145600000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176680.829703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176680.829711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe67480 x1872931145600000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176680.829719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145600000/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176680.829724:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176680.829726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829728:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145600000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176680.829732:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145600128:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176680.829742:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176680.829748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe64a80 x1872931145600128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176680.829755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145600128/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176680.829760:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176680.829761:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145600128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176680.829777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145600256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176680.829787:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176680.829794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe66300 x1872931145600256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176680.829800:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145600256/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176680.829805:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176680.829807:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145600256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176680.829812:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145600384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176680.829821:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176680.829827:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176680/real 1786176680]  req@ffff89d99fe65180 x1872931145600384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176680.829834:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145600384/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176680.829840:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176680.829841:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176680.829843:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145600384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176681.341016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176681.341081:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176681.853029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176682.365015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176682.365073:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176682.876976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176683.389060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176683.389124:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176683.901020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176684.413024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176684.413091:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176684.924992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176685.437025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176685.437126:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176685.948947:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176685.949014:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176685.949021:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176685.949026:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176685.949035:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949044:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176685.949052:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176685.949089:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145600512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176685.949119:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176685.949124:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176685.949126:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176685.949131:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949136:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176685.949140:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176685.949149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145600512:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176685.949150:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176685.949164:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145600640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176685.949173:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176685.949176:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176685.949177:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176685.949180:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949182:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176685.949184:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176685.949188:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176685.949196:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145600768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176685.949202:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176685.949205:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176685.949207:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176685.949209:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949211:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176685.949213:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176685.949217:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1786176685.949217:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176685.949229:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145600896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176685.949235:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176685.949238:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176685.949240:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176685.949242:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949245:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176685.949248:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176685.949250:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176685.949258:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145601024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176685.949261:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f3100 x1872931145600512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176685.949271:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176685.949278:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176685.949280:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176685.949285:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949287:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176685.949288:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145600512/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176685.949293:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176685.949300:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176685.949305:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176685.949310:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145601152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176685.949313:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176685.949322:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176685.949324:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145600512:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176685.949325:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176685.949329:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176685.949335:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949338:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176685.949340:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176685.949343:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176685.949350:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145601280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176685.949356:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176685.949359:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145600640:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176685.949360:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176685.949362:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176685.949369:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949371:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176685.949374:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176685.949378:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176685.949387:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145601408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176685.949393:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176685.949397:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176685.949398:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1786176685.949402:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176685.949405:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10420
00000100:00080000:0.0:1786176685.949410:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176685.949412:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176685.949416:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176685.949420:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f0e00 x1872931145600640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176685.949426:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145601536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176685.949435:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145600640/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176685.949443:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176685.949446:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176685.949450:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145600640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176685.949454:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145600768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176685.949469:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176685.949476:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f1500 x1872931145600768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176685.949484:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145600768/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176685.949489:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176685.949552:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176685.949555:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145600768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176685.949560:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145600896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176685.949580:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176685.949593:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f1880 x1872931145600896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176685.949606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145600896/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176685.949615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176685.949619:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176685.949622:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145600896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176685.949627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145601024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176685.949643:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176685.949651:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f2680 x1872931145601024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176685.949664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145601024/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176685.949669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176685.949671:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176685.949673:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145601024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176685.949676:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145601152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176685.949687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176685.949692:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f2a00 x1872931145601152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176685.949699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145601152/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176685.949704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176685.949706:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176685.949708:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145601152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176685.949720:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145601280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176685.949730:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176685.949736:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f2d80 x1872931145601280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176685.949743:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145601280/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176685.949751:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176685.949754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176685.949756:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145601280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176685.949759:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145601408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176685.949768:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176685.949773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f0700 x1872931145601408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176685.949780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145601408/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176685.949786:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176685.949788:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176685.949789:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145601408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176685.949793:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145601536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176685.949802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176685.949808:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176685/real 1786176685]  req@ffff89d9870f3b80 x1872931145601536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176685.949820:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145601536/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176685.949828:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176685.949831:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176685.949835:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145601536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176686.460996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176686.461071:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176686.972988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176687.484976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176687.485058:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176687.996945:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176688.508999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176688.509048:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176689.020980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176689.533016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176689.533085:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176690.044997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176690.557037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176690.557105:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176691.068986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176691.069001:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069008:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176691.069013:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176691.069024:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00080000:0.0:1786176691.069037:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176691.069047:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176691.069091:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145601664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176691.069122:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069126:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176691.069128:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176691.069131:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00080000:0.0:1786176691.069135:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176691.069139:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176691.069149:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176691.069158:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145601664:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176691.069164:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145601792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176691.069173:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069176:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176691.069177:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176691.069181:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00080000:0.0:1786176691.069186:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176691.069189:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176691.069194:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176691.069205:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145601920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176691.069211:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069214:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176691.069216:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176691.069218:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00080000:0.0:1786176691.069228:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176691.069231:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176691.069236:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176691.069241:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176691.069251:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145602048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176691.069261:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069264:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176691.069268:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176691.069272:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00080000:0.0:1786176691.069276:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176691.069279:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176691.069282:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176691.069295:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145602176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176691.069307:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069311:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176691.069315:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176691.069316:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f0a80 x1872931145601664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176691.069326:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00080000:0.0:1786176691.069334:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176691.069342:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176691.069347:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176691.069357:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145601664/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176691.069358:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145602304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176691.069388:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069391:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176691.069393:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176691.069395:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176691.069400:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00080000:1.0:1786176691.069404:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176691.069406:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176691.069412:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145601664:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176691.069414:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176691.069422:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176691.069432:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145602432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176691.069438:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069454:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176691.069457:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176691.069467:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00100000:1.0:1786176691.069467:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145601792:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176691.069475:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176691.069480:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176691.069484:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176691.069496:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145602560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176691.069502:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176691.069512:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176691.069515:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176691.069516:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176691.069520:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10425
00000100:00080000:0.0:1786176691.069522:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176691.069525:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176691.069529:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f1180 x1872931145601792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176691.069531:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176691.069545:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145602688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176691.069550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145601792/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176691.069568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176691.069571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176691.069575:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145601792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176691.069581:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145601920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176691.069600:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176691.069612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f3480 x1872931145601920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176691.069622:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145601920/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176691.069629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176691.069632:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176691.069636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145601920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176691.069641:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145602048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176691.069653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176691.069661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f3b80 x1872931145602048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176691.069671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145602048/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176691.069683:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176691.069686:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176691.069689:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145602048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176691.069693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145602176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176691.069705:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176691.069712:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f0700 x1872931145602176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176691.069722:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145602176/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176691.069728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176691.069731:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176691.069734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145602176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176691.069742:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145602304:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176691.069754:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176691.069761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f2d80 x1872931145602304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176691.069768:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145602304/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176691.069773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176691.069775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176691.069777:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145602304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176691.069780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145602432:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176691.069789:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176691.069795:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f2a00 x1872931145602432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176691.069803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145602432/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176691.069808:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176691.069811:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176691.069813:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145602432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176691.069829:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145602560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176691.069839:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176691.069845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f2680 x1872931145602560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176691.069853:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145602560/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176691.069859:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176691.069860:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176691.069862:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145602560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176691.069866:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145602688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176691.069887:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176691.069894:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176691/real 1786176691]  req@ffff89d9870f1880 x1872931145602688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176691.069927:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145602688/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176691.069934:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176691.069937:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176691.069942:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145602688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176691.581044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176691.581114:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176692.093048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176692.605009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176692.605074:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176693.117012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176693.629039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176693.629101:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176694.141004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176694.653009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176694.653085:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176695.165029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176695.677007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176695.677069:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176696.189003:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176696.189006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176696.189014:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176696.189018:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189026:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10430
00000100:00080000:3.0:1786176696.189036:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189042:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176696.189073:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145602816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176696.189094:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176696.189097:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176696.189098:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189101:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10430
00000100:00080000:3.0:1786176696.189103:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189106:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176696.189113:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176696.189122:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145602816:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176696.189125:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145602944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176696.189134:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176696.189136:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176696.189137:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189140:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10430
00000100:00080000:3.0:1786176696.189142:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189144:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176696.189147:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176696.189157:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145603072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176696.189163:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176696.189165:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176696.189167:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189169:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10430
00000100:00080000:3.0:1786176696.189172:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189174:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176696.189177:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176696.189181:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176696.189185:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145603200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176696.189193:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176696.189196:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176696.189197:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189201:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10430
00000100:00080000:3.0:1786176696.189203:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189205:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176696.189208:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176696.189216:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145603328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176696.189221:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe64000 x1872931145602816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176696.189226:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176696.189232:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176696.189235:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189241:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10430
00000100:00080000:3.0:1786176696.189243:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189248:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176696.189249:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145602816/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176696.189251:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176696.189262:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145603456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176696.189263:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189271:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176696.189277:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145602816:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176696.189278:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176696.189284:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176696.189286:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189289:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10430
00000100:00080000:3.0:1786176696.189292:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189294:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176696.189296:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176696.189303:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145602944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176696.189306:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145603584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176696.189315:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176696.189317:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176696.189318:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189321:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10430
00000800:00000100:1.0:1786176696.189324:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176696.189324:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189328:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176696.189332:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176696.189338:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe66a00 x1872931145602944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176696.189351:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145602944/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176696.189352:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145603712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176696.189373:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189381:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176696.189381:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176696.189385:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145602944:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176696.189387:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176696.189411:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145603072:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176696.189415:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176696.189421:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10430
00000100:00080000:3.0:1786176696.189426:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176696.189431:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176696.189432:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176696.189440:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176696.189446:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe65500 x1872931145603072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176696.189453:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145603840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176696.189461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145603072/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176696.189472:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189477:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176696.189481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145603072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176696.189487:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145603200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176696.189506:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176696.189518:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe67b80 x1872931145603200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176696.189529:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145603200/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176696.189538:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189540:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176696.189543:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145603200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176696.189549:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145603328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176696.189569:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176696.189581:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe66d80 x1872931145603328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176696.189592:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145603328/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176696.189599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189602:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176696.189605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145603328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176696.189621:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145603456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176696.189647:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176696.189658:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe64700 x1872931145603456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176696.189671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145603456/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176696.189679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189681:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176696.189683:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145603456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176696.189698:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145603584:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176696.189720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176696.189732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe64380 x1872931145603584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176696.189752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145603584/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176696.189761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176696.189768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145603584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176696.189774:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145603712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176696.189791:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176696.189799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe65f80 x1872931145603712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176696.189807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145603712/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176696.189812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189814:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176696.189816:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145603712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176696.189820:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145603840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176696.189830:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176696.189835:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176696/real 1786176696]  req@ffff89d99fe64000 x1872931145603840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176696.189842:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145603840/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176696.189851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176696.189853:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176696.189855:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145603840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176696.700957:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176696.701036:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176697.213083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176697.725020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176697.725096:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176698.237043:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176698.749000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176698.749066:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176699.261009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176699.773009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176699.773097:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176700.284984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176700.796988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176700.797031:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176701.309003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176701.309010:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176701.309017:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176701.309021:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176701.309029:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309038:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176701.309045:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176701.309087:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145603968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176701.309109:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176701.309112:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176701.309114:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176701.309116:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309119:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176701.309122:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176701.309130:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176701.309142:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145604096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176701.309142:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145603968:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176701.309157:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176701.309159:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176701.309160:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176701.309164:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309167:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176701.309169:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176701.309172:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176701.309182:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145604224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176701.309189:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176701.309191:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176701.309193:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176701.309195:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309198:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176701.309200:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176701.309204:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176701.309205:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176701.309216:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145604352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176701.309225:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176701.309227:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176701.309228:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176701.309231:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309233:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176701.309235:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176701.309239:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176701.309245:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f1500 x1872931145603968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176701.309249:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145604480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176701.309261:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176701.309268:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176701.309272:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176701.309277:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309279:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176701.309284:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176701.309285:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145603968/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176701.309288:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176701.309300:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145604608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176701.309300:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309309:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176701.309314:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176701.309318:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145603968:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176701.309319:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176701.309323:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176701.309328:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309330:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176701.309333:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176701.309336:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176701.309364:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145604096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176701.309374:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145604736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176701.309385:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176701.309390:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176701.309395:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786176701.309399:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f0e00 x1872931145604096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176701.309400:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176701.309412:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309420:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176701.309425:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145604096/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176701.309428:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176701.309437:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176701.309439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309444:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176701.309447:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145604096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176701.309452:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145604864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176701.309455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145604224:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176701.309469:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176701.309473:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176701.309475:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176701.309478:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176701.309483:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10435
00000100:00080000:0.0:1786176701.309488:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176701.309492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f3100 x1872931145604224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176701.309493:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176701.309511:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176701.309521:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145604224/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176701.309526:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145604992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176701.309533:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309540:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176701.309544:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145604224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176701.309549:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145604352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176701.309563:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176701.309569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f1880 x1872931145604352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176701.309576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145604352/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176701.309586:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176701.309590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145604352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176701.309594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145604480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176701.309603:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176701.309608:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f2680 x1872931145604480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176701.309615:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145604480/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176701.309621:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309622:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176701.309624:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145604480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176701.309627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145604608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176701.309637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176701.309642:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f2a00 x1872931145604608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176701.309649:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145604608/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176701.309660:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309662:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176701.309664:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145604608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176701.309678:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145604736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176701.309688:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176701.309694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f2d80 x1872931145604736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176701.309702:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145604736/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176701.309707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309708:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176701.309710:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145604736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176701.309714:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145604864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176701.309723:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176701.309729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f0700 x1872931145604864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176701.309736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145604864/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176701.309741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309743:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176701.309745:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145604864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176701.309748:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145604992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176701.309756:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176701.309762:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176701/real 1786176701]  req@ffff89d9870f3b80 x1872931145604992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176701.309769:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145604992/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176701.309774:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176701.309776:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176701.309778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145604992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176701.821004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176701.821070:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176702.333024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176702.845027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176702.845122:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176703.356990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176703.869063:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176703.869132:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176704.381050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176704.893004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176704.893071:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176705.404965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176705.917006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176705.917072:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176706.429046:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176706.429060:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176706.429065:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176706.429077:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00100000:3.0:1786176706.429084:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176706.429091:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176706.429101:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176706.429141:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145605120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176706.429165:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176706.429168:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176706.429170:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176706.429179:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00080000:2.0:1786176706.429184:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176706.429188:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176706.429196:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176706.429206:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145605120:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176706.429208:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145605248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176706.429232:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176706.429234:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176706.429235:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176706.429240:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00080000:2.0:1786176706.429243:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176706.429245:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176706.429249:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176706.429260:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145605376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176706.429275:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176706.429277:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176706.429279:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176706.429281:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00080000:2.0:1786176706.429285:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176706.429287:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176706.429291:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176706.429319:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145605504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176706.429325:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176706.429336:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176706.429340:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176706.429341:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176706.429345:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00080000:2.0:1786176706.429349:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176706.429354:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176706.429357:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176706.429365:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145605632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176706.429373:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176706.429376:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176706.429378:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176706.429383:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00080000:2.0:1786176706.429387:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176706.429393:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176706.429394:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87d500 x1872931145605120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176706.429404:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176706.429423:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145605760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176706.429431:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145605120/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176706.429443:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176706.429462:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176706.429470:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176706.429479:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00080000:1.0:1786176706.429480:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176706.429489:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176706.429502:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176706.429503:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145605120:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176706.429516:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176706.429522:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176706.429533:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145605888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176706.429543:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176706.429547:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145605248:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176706.429548:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176706.429553:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176706.429572:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00080000:2.0:1786176706.429579:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176706.429582:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176706.429586:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176706.429593:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176706.429607:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145606016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176706.429614:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87c000 x1872931145605248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176706.429670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145605248/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176706.429670:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176706.429688:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176706.429694:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176706.429708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176706.429708:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10440
00000100:00080000:2.0:1786176706.429718:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176706.429722:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176706.429729:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786176706.429729:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176706.429739:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145605248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176706.429745:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145606144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176706.429755:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145605376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176706.429778:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176706.429789:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87f100 x1872931145605376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176706.429798:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145605376/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176706.429804:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176706.429807:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176706.429809:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145605376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176706.429814:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145605504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176706.429826:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176706.429832:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87df80 x1872931145605504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176706.429844:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145605504/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176706.429849:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176706.429851:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176706.429853:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145605504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176706.429857:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145605632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176706.429867:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176706.429873:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87f800 x1872931145605632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176706.429879:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145605632/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176706.429884:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176706.429886:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176706.429888:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145605632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176706.429891:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145605760:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176706.429924:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176706.429931:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87d880 x1872931145605760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176706.429939:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145605760/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176706.429949:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176706.429951:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176706.429953:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145605760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176706.429969:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145605888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176706.429981:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176706.429988:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87e680 x1872931145605888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176706.429995:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145605888/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176706.430001:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176706.430002:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176706.430004:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145605888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176706.430008:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145606016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176706.430019:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176706.430025:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87dc00 x1872931145606016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176706.430032:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145606016/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176706.430037:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176706.430039:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176706.430042:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145606016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176706.430045:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145606144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176706.430055:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176706.430060:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176706/real 1786176706]  req@ffff89d99e87ca80 x1872931145606144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176706.430067:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145606144/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176706.430072:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176706.430074:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176706.430075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145606144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176706.941016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176706.941093:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176707.452996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176707.965006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176707.965064:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176708.477059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176708.989011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176708.989081:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176709.500977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176710.013001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176710.013069:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176710.524992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176711.037057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176711.037149:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176711.548961:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176711.548970:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176711.548974:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.548983:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10445
00000100:00080000:2.0:1786176711.548992:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176711.549000:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176711.549039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786176711.549041:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145606272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176711.549070:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176711.549074:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176711.549078:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.549083:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10445
00000100:00080000:2.0:1786176711.549087:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176711.549091:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176711.549102:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176711.549105:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145606272:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176711.549118:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145606400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176711.549129:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176711.549132:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176711.549134:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.549136:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10445
00000100:00080000:2.0:1786176711.549139:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176711.549141:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176711.549154:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176711.549171:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145606528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176711.549182:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176711.549189:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176711.549189:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176711.549194:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.549201:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10445
00000100:00080000:2.0:1786176711.549209:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176711.549214:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176711.549220:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176711.549233:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145606656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176711.549242:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176711.549263:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87c380 x1872931145606272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176711.549264:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176711.549269:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.549282:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10445
00000100:00080000:2.0:1786176711.549293:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176711.549299:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176711.549307:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176711.549310:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145606272/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176711.549321:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145606784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176711.549324:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.549340:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176711.549346:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176711.549354:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176711.549355:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145606272:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176711.549360:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.549366:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10445
00000100:00080000:2.0:1786176711.549369:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176711.549373:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176711.549378:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176711.549394:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145606400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176711.549397:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145606912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176711.549417:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176711.549422:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000800:00000100:1.0:1786176711.549427:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176711.549428:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.549437:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10445
00000100:00080000:2.0:1786176711.549444:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176711.549449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87c700 x1872931145606400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176711.549450:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176711.549463:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176711.549471:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145606400/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176711.549480:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145607040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176711.549482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.549491:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176711.549500:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145606400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176711.549513:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145606528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176711.549514:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176711.549527:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176711.549530:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.549539:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10445
00000800:00000100:1.0:1786176711.549540:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176711.549547:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176711.549556:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87ed80 x1872931145606528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176711.549557:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176711.549569:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176711.549578:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145606528/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176711.549587:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145607168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176711.549589:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.549604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176711.549619:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145606528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176711.549623:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176711.549630:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176711.549635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145606656:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176711.549635:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176711.549654:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10445
00000100:00080000:2.0:1786176711.549660:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176711.549664:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176711.549667:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176711.549672:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176711.549681:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145607296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176711.549688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87ca80 x1872931145606656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176711.549741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145606656/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176711.549753:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.549758:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176711.549762:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145606656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176711.549771:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145606784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176711.549793:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176711.549801:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87dc00 x1872931145606784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176711.549810:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145606784/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176711.549815:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.549818:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176711.549820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145606784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176711.549837:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145606912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176711.549848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176711.549855:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87e680 x1872931145606912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176711.549867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145606912/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176711.549872:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.549874:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176711.549876:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145606912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176711.549879:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145607040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176711.549890:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176711.549919:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87d880 x1872931145607040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176711.549928:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145607040/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176711.549934:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.549936:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176711.549938:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145607040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176711.549943:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145607168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176711.549955:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176711.549962:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87f800 x1872931145607168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176711.549969:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145607168/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176711.549980:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.549982:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176711.549984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145607168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176711.549988:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145607296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176711.549997:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176711.550003:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176711/real 1786176711]  req@ffff89d99e87df80 x1872931145607296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176711.550010:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145607296/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176711.550016:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176711.550018:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176711.550020:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145607296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176712.060977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176712.061042:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176712.573014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176713.085003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176713.085070:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176713.597001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176714.108966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176714.109045:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176714.621006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176715.133015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176715.133080:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176715.645017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176716.156985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176716.157036:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176716.668982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176716.669030:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176716.669035:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176716.669039:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176716.669045:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:0.0:1786176716.669054:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176716.669060:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176716.669092:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145607424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176716.669114:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176716.669117:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176716.669119:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176716.669123:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:0.0:1786176716.669128:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176716.669133:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176716.669142:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145607424:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176716.669143:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176716.669162:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145607552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176716.669175:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176716.669177:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176716.669179:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176716.669182:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:0.0:1786176716.669192:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176716.669207:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176716.669212:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176716.669217:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176716.669226:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145607680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176716.669235:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176716.669238:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176716.669239:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176716.669242:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:0.0:1786176716.669245:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176716.669248:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176716.669252:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176716.669256:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f3480 x1872931145607424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176716.669263:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145607808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176716.669290:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176716.669291:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145607424/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176716.669296:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176716.669299:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176716.669307:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:1.0:1786176716.669309:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176716.669310:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176716.669316:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176716.669319:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786176716.669322:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176716.669326:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145607424:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176716.669333:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145607936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176716.669340:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176716.669342:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176716.669344:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176716.669347:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:0.0:1786176716.669350:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176716.669350:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145607552:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176716.669355:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176716.669359:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176716.669374:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145608064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176716.669381:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176716.669389:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176716.669392:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176716.669394:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176716.669397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f1180 x1872931145607552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176716.669399:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:0.0:1786176716.669403:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176716.669410:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176716.669417:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176716.669420:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145607552/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176716.669429:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145608192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176716.669430:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176716.669438:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176716.669446:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145607552:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176716.669447:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176716.669453:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176716.669454:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176716.669458:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145607680:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176716.669462:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:0.0:1786176716.669466:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176716.669469:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176716.669472:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176716.669481:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176716.669483:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145608320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176716.669491:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176716.669492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f0a80 x1872931145607680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176716.669497:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176716.669500:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176716.669507:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10450
00000100:00080000:0.0:1786176716.669510:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176716.669512:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145607680/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176716.669515:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176716.669522:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176716.669533:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145608448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176716.669533:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176716.669543:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176716.669549:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145607680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176716.669554:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145607808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176716.669568:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176716.669574:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f3b80 x1872931145607808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176716.669581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145607808/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176716.669586:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176716.669588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176716.669590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145607808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176716.669594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145607936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176716.669603:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176716.669609:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f0700 x1872931145607936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176716.669620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145607936/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176716.669629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176716.669632:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176716.669635:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145607936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176716.669665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145608064:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176716.669681:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176716.669690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f2d80 x1872931145608064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176716.669697:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145608064/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176716.669703:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176716.669705:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176716.669707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145608064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176716.669711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145608192:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176716.669720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176716.669726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f2a00 x1872931145608192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176716.669733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145608192/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176716.669738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176716.669739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176716.669741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145608192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176716.669744:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145608320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176716.669753:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176716.669759:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f2680 x1872931145608320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176716.669766:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145608320/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176716.669771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176716.669773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176716.669775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145608320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176716.669778:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145608448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176716.669787:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176716.669792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176716/real 1786176716]  req@ffff89d9870f1880 x1872931145608448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176716.669799:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145608448/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176716.669804:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176716.669806:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176716.669808:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145608448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176717.181016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176717.181081:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176717.693008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176718.204981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176718.205053:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176718.717004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176719.229027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176719.229109:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176719.741038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176720.253029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176720.253098:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176720.764980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176721.277028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176721.277094:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176721.789039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176721.789226:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176721.789234:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176721.789245:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789257:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789274:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176721.789282:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176721.789335:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145608576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176721.789396:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176721.789400:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176721.789403:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789407:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789412:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176721.789417:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176721.789429:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145608576:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176721.789429:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176721.789448:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145608704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176721.789460:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176721.789464:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176721.789466:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789471:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789475:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176721.789479:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176721.789484:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176721.789502:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145608832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176721.789512:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176721.789516:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176721.789517:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789525:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789530:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176721.789534:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176721.789540:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176721.789559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145608704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176721.789571:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145608960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176721.789583:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176721.789587:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176721.789589:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789594:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789598:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176721.789603:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145608832:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176721.789611:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176721.789617:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176721.789630:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145609088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176721.789644:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176721.789646:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145608960:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176721.789652:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176721.789657:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789661:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789666:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176721.789674:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176721.789679:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176721.789685:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145609088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176721.789693:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145609216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176721.789716:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176721.789719:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145609216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176721.789722:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176721.789726:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789736:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789741:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176721.789746:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176721.789751:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176721.789763:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145609344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176721.789780:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176721.789784:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176721.789786:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789790:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789795:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176721.789800:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176721.789806:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176721.789808:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145609344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176721.789820:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145609472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176721.789832:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176721.789836:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176721.789838:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176721.789843:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10456
00000100:00080000:3.0:1786176721.789848:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176721.789851:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145609472:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176721.789854:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176721.789863:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176721.789876:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145609600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176721.789925:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145609600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176722.300989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176722.301085:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176722.813021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176723.325019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176723.325067:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176723.837036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176724.349081:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176724.349165:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176724.861026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:1.0:1786176724.861318:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:1.0:1786176724.861378:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1786176724.861401:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786176724.861466:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:1.0:1786176724.861490:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786176724.861503:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176724.861509:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe64000 x1872931145609600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1786176724.861519:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786176724.861537:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176724.861550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145609600/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:1.0:1786176724.861577:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:3.0:1786176724.861587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000800:00000100:1.0:1786176724.861591:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176724.861597:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145609600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176724.861608:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:3.0:1786176724.861612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe65880 x1872931145609344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176724.861632:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145609344/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861641:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176724.861645:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176724.861649:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145609344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176724.861656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe66680 x1872931145609216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176724.861668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145609216/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176724.861680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176724.861684:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145609216:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176724.861691:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe67480 x1872931145608960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176724.861703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145608960/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176724.861715:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176724.861719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145608960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176724.861727:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe67800 x1872931145609088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176724.861739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145609088/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861747:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176724.861751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176724.861755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145609088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176724.861763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe66300 x1872931145608704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176724.861776:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145608704/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176724.861787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176724.861791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145608704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176724.861798:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe64a80 x1872931145608832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176724.861809:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145608832/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861818:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176724.861821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176724.861825:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145608832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176724.861832:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe65180 x1872931145608576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176724.861845:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145608576/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861853:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176724.861856:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176724.861860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145608576:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176724.861924:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176721/real 1786176724]  req@ffff89d99fe67100 x1872931145609472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176724.861940:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145609472/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176724.861950:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176724.861955:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176724.861960:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145609472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176725.373061:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176725.373149:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176725.885020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176726.397039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176726.397128:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176726.909063:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176726.909070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176726.909074:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176726.909081:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909092:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00080000:0.0:1786176726.909116:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909124:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176726.909162:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145609728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176726.909195:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176726.909199:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176726.909202:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909207:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00080000:0.0:1786176726.909213:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909218:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176726.909228:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176726.909248:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145609856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176726.909254:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145609728:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176726.909266:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176726.909271:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176726.909274:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909279:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00080000:0.0:1786176726.909284:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909288:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176726.909295:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176726.909310:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145609984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176726.909321:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176726.909325:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176726.909327:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909331:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00080000:0.0:1786176726.909337:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909342:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176726.909347:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176726.909360:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145610112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176726.909368:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176726.909375:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1786176726.909377:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176726.909379:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909388:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00080000:0.0:1786176726.909393:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909398:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176726.909407:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176726.909424:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145610240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176726.909433:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176726.909436:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176726.909438:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909442:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00080000:0.0:1786176726.909447:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909452:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176726.909457:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176726.909471:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f3100 x1872931145609728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176726.909474:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145610368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176726.909546:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176726.909550:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176726.909553:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909561:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00100000:2.0:1786176726.909568:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145609728/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176726.909569:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909582:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176726.909596:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786176726.909606:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176726.909620:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176726.909626:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145610496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176726.909633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145609728:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176726.909670:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176726.909675:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176726.909678:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909688:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00100000:2.0:1786176726.909690:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145609856:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176726.909697:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909705:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176726.909711:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176726.909730:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145610624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176726.909736:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176726.909755:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176726.909760:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786176726.909764:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f0e00 x1872931145609856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176726.909765:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176726.909778:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10461
00000100:00080000:0.0:1786176726.909790:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176726.909801:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176726.909807:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176726.909808:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145609856/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176726.909825:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176726.909826:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145610752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176726.909836:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176726.909855:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145609856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176726.909868:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145609984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176726.909943:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176726.909960:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f1500 x1872931145609984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176726.909974:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145609984/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176726.909990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176726.909994:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176726.909997:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145609984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176726.910005:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145610112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176726.910035:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176726.910049:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f1880 x1872931145610112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176726.910060:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145610112/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176726.910068:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176726.910071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176726.910075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145610112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176726.910081:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145610240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176726.910122:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176726.910134:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f2680 x1872931145610240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176726.910146:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145610240/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176726.910153:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176726.910156:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176726.910160:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145610240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176726.910166:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145610368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176726.910187:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176726.910198:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f2a00 x1872931145610368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176726.910210:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145610368/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176726.910218:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176726.910221:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176726.910225:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145610368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176726.910232:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145610496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176726.910252:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176726.910265:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f2d80 x1872931145610496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176726.910278:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145610496/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176726.910286:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176726.910290:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176726.910293:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145610496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176726.910324:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145610624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176726.910348:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176726.910361:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f0700 x1872931145610624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176726.910372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145610624/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176726.910383:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176726.910386:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176726.910390:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145610624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176726.910397:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145610752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176726.910418:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176726.910435:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176726/real 1786176726]  req@ffff89d9870f3b80 x1872931145610752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176726.910451:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145610752/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176726.910460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176726.910465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176726.910468:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145610752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176727.421038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176727.421107:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176727.933037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176728.445034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176728.445134:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176728.957014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176729.469024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176729.469111:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176729.981005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176730.493013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176730.493107:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176731.005083:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176731.517037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176731.517133:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176732.029017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176732.029084:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176732.029088:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176732.029091:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176732.029098:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:1.0:1786176732.029106:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029113:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176732.029155:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145610880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176732.029191:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176732.029194:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176732.029195:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176732.029198:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:1.0:1786176732.029202:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029205:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176732.029212:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176732.029229:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145611008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176732.029238:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176732.029241:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145610880:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176732.029242:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176732.029246:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176732.029252:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:1.0:1786176732.029255:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029257:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176732.029260:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176732.029269:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145611136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176732.029276:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176732.029278:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176732.029279:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176732.029282:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:1.0:1786176732.029284:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029286:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176732.029289:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176732.029297:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145611264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176732.029304:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176732.029310:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176732.029312:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176732.029314:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176732.029318:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:1.0:1786176732.029323:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029325:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176732.029328:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176732.029336:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145611392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176732.029343:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2ff800 x1872931145610880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176732.029344:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176732.029351:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176732.029354:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176732.029360:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:1.0:1786176732.029363:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029368:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029368:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145610880/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176732.029375:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786176732.029386:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176732.029388:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145611520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176732.029391:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176732.029399:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145610880:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176732.029403:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176732.029406:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176732.029408:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176732.029411:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:1.0:1786176732.029413:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029415:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176732.029418:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176732.029422:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145611008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176732.029427:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145611648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176732.029435:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176732.029438:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176732.029440:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786176732.029444:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176732.029447:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:1.0:1786176732.029452:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029455:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176732.029458:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176732.029460:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2fc700 x1872931145611008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176732.029468:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145611776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176732.029473:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145611008/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176732.029479:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176732.029487:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176732.029490:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176732.029491:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176732.029494:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10466
00000100:00080000:2.0:1786176732.029498:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176732.029499:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176732.029505:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029505:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145611008:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786176732.029511:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176732.029515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145611136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176732.029521:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145611904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176732.029533:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029542:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2ff480 x1872931145611136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176732.029550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145611136/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176732.029556:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176732.029558:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176732.029560:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145611136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176732.029564:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145611264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176732.029575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029580:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2fdc00 x1872931145611264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176732.029588:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145611264/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176732.029593:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176732.029595:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176732.029596:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145611264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176732.029600:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145611392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176732.029609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029614:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2fe300 x1872931145611392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176732.029621:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145611392/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176732.029625:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176732.029627:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176732.029629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145611392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176732.029633:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145611520:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176732.029642:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029647:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2fe680 x1872931145611520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176732.029655:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145611520/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176732.029659:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176732.029661:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176732.029663:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145611520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176732.029675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145611648:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176732.029685:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2fd880 x1872931145611648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176732.029697:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145611648/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176732.029702:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176732.029703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176732.029705:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145611648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176732.029709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145611776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176732.029719:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029724:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2fce00 x1872931145611776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176732.029732:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145611776/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176732.029741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176732.029744:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176732.029746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145611776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176732.029749:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145611904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176732.029758:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176732.029763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176732/real 1786176732]  req@ffff89d9ba2ff800 x1872931145611904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176732.029770:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145611904/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176732.029775:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176732.029777:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176732.029778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145611904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176732.540988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176732.541090:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176733.053071:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176733.564974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176733.565086:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176734.077087:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176734.589001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176734.589078:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176735.101096:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176735.612980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176735.613083:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176736.124991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176736.637020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176736.637115:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176737.148993:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176737.149014:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176737.149019:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176737.149028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176737.149029:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10471
00000100:00080000:2.0:1786176737.149039:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176737.149048:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176737.149086:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145612032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176737.149110:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176737.149114:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176737.149117:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176737.149121:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10471
00000100:00080000:2.0:1786176737.149125:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176737.149129:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176737.149138:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176737.149145:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145612032:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176737.149151:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145612160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176737.149161:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176737.149164:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176737.149174:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176737.149178:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10471
00000100:00080000:2.0:1786176737.149189:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176737.149193:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176737.149198:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1786176737.149204:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176737.149208:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145612288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176737.149217:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176737.149220:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176737.149221:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176737.149225:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10471
00000100:00080000:2.0:1786176737.149228:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176737.149231:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176737.149236:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176737.149240:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87f100 x1872931145612032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176737.149247:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145612416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176737.149257:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176737.149261:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176737.149262:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1786176737.149265:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145612032/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176737.149266:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10471
00000100:00080000:2.0:1786176737.149270:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176737.149273:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:3.0:1786176737.149275:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176737.149277:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1786176737.149279:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176737.149284:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145612032:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176737.149286:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145612544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176737.149293:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176737.149296:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176737.149298:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176737.149301:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10471
00000100:00080000:2.0:1786176737.149304:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176737.149305:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145612160:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176737.149308:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176737.149312:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176737.149321:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145612672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176737.149326:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176737.149337:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176737.149337:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87c000 x1872931145612160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176737.149341:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176737.149343:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176737.149347:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10471
00000100:00080000:2.0:1786176737.149350:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1786176737.149350:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145612160/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176737.149354:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176737.149358:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1786176737.149360:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176737.149363:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176737.149366:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145612160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176737.149368:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145612800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176737.149372:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145612288:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176737.149377:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176737.149380:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176737.149382:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176737.149386:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10471
00000800:00000100:3.0:1786176737.149389:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176737.149390:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176737.149393:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176737.149398:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176737.149399:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87d500 x1872931145612288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176737.149407:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145612928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176737.149412:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145612288/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176737.149417:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176737.149421:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176737.149423:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176737.149426:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10471
00000100:00080000:3.0:1786176737.149427:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176737.149430:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176737.149430:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176737.149434:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176737.149434:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145612288:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176737.149438:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176737.149440:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145612416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176737.149447:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145613056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1786176737.149457:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176737.149467:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87df80 x1872931145612416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176737.149489:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145612416/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176737.149497:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176737.149500:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176737.149504:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145612416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176737.149511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145612544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176737.149532:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176737.149544:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87f800 x1872931145612544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176737.149557:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145612544/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176737.149563:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176737.149565:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176737.149568:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145612544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176737.149581:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145612672:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176737.149595:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176737.149602:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87d880 x1872931145612672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176737.149610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145612672/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176737.149615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176737.149617:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176737.149618:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145612672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176737.149622:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145612800:192.168.202.130@tcp:38:kworker.0
00000800:00000100:3.0:1786176737.149631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176737.149637:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87e680 x1872931145612800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176737.149644:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145612800/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176737.149649:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176737.149650:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176737.149652:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145612800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176737.149655:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145612928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176737.149664:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176737.149670:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87dc00 x1872931145612928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176737.149677:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145612928/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176737.149683:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176737.149684:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176737.149686:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145612928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176737.149689:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145613056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:3.0:1786176737.149698:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176737.149704:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176737/real 1786176737]  req@ffff89d99e87ca80 x1872931145613056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176737.149711:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145613056/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176737.149716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176737.149718:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176737.149719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145613056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176737.660968:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176737.661098:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176738.172985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176738.685048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176738.685118:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176739.197018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176739.709020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176739.709061:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176740.221006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176740.733014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176740.733103:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176741.245042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176741.757037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176741.757118:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176742.269022:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269033:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176742.269039:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269052:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00100000:0.0:1786176742.269053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176742.269063:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176742.269073:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176742.269121:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145613184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176742.269156:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269159:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176742.269161:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269166:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00080000:3.0:1786176742.269170:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176742.269173:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176742.269202:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176742.269209:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145613184:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176742.269219:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145613312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176742.269230:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269233:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176742.269235:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269239:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00080000:3.0:1786176742.269243:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176742.269246:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176742.269268:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176742.269278:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145613440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176742.269285:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269287:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176742.269289:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269291:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00080000:3.0:1786176742.269304:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176742.269307:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176742.269311:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176742.269335:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145613568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176742.269345:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176742.269356:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269361:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176742.269363:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269369:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00080000:3.0:1786176742.269374:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176742.269378:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176742.269382:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176742.269394:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145613696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176742.269419:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269422:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176742.269424:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269429:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00100000:2.0:1786176742.269434:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe67100 x1872931145613184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176742.269435:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176742.269445:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176742.269454:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176742.269483:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145613184/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176742.269485:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145613824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176742.269511:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176742.269511:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269518:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176742.269521:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176742.269522:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269529:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00080000:3.0:1786176742.269533:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176742.269534:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145613184:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176742.269537:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176742.269544:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176742.269550:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145613952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176742.269557:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269559:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176742.269560:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269563:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00080000:3.0:1786176742.269565:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176742.269568:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176742.269570:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176742.269577:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145614080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176742.269582:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145613312:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176742.269601:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176742.269605:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176742.269607:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176742.269611:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10476
00000100:00080000:3.0:1786176742.269619:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176742.269622:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786176742.269626:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176742.269629:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176742.269643:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe65180 x1872931145613312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176742.269644:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145614208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176742.269681:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145613312/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176742.269708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176742.269711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176742.269716:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145613312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176742.269722:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145613440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176742.269741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176742.269749:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe64a80 x1872931145613440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176742.269769:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145613440/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176742.269775:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176742.269778:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176742.269780:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145613440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176742.269784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145613568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176742.269798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176742.269804:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe66300 x1872931145613568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176742.269813:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145613568/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176742.269819:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176742.269821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176742.269823:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145613568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176742.269826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145613696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176742.269838:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176742.269845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe67800 x1872931145613696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176742.269854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145613696/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176742.269860:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176742.269862:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176742.269864:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145613696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176742.269877:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145613824:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176742.269919:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176742.269928:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe67480 x1872931145613824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176742.269938:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145613824/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176742.269944:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176742.269964:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176742.269967:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145613824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176742.269989:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145613952:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176742.270011:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176742.270023:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe66680 x1872931145613952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176742.270036:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145613952/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176742.270045:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176742.270048:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176742.270050:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145613952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176742.270066:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145614080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176742.270081:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176742.270089:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe65880 x1872931145614080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176742.270096:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145614080/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176742.270102:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176742.270105:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176742.270106:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145614080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176742.270110:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145614208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176742.270120:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176742.270126:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176742/real 1786176742]  req@ffff89d99fe64000 x1872931145614208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176742.270133:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145614208/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176742.270138:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176742.270140:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176742.270143:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145614208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176742.781022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176742.781105:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176743.293041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176743.805055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176743.805131:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176744.317064:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176744.829029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176744.829105:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176745.341049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176745.853041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176745.853109:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176746.365002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176746.876997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176746.877056:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176747.389067:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176747.389075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176747.389079:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176747.389087:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176747.389100:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10481
00000100:00080000:3.0:1786176747.389110:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176747.389119:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176747.389158:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145614336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176747.389191:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176747.389196:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176747.389199:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176747.389203:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10481
00000100:00080000:3.0:1786176747.389208:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176747.389221:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176747.389232:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176747.389234:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145614336:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176747.389251:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145614464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176747.389265:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176747.389269:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176747.389271:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176747.389277:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10481
00000100:00080000:3.0:1786176747.389282:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176747.389286:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786176747.389291:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176747.389295:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176747.389313:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145614592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176747.389325:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176747.389331:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe65f80 x1872931145614336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176747.389331:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176747.389336:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176747.389347:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10481
00000100:00080000:3.0:1786176747.389353:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176747.389355:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145614336/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176747.389361:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786176747.389368:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786176747.389371:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786176747.389373:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176747.389379:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145614336:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176747.389390:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145614720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176747.389400:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145614464:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176747.389405:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176747.389410:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176747.389412:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176747.389418:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10481
00000100:00080000:3.0:1786176747.389426:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786176747.389430:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176747.389434:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176747.389442:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176747.389446:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe64380 x1872931145614464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176747.389462:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145614464/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176747.389463:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145614848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176747.389484:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176747.389489:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176747.389492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176747.389496:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1786176747.389500:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145614464:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176747.389501:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176747.389512:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10481
00000100:00100000:2.0:1786176747.389516:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145614592:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176747.389519:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176747.389527:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176747.389533:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176747.389541:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176747.389549:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145614976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176747.389554:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe64700 x1872931145614592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176747.389581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145614592/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176747.389588:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176747.389590:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176747.389591:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176747.389595:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145614592:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176747.389600:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176747.389605:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176747.389611:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145614720:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176747.389613:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10481
00000100:00080000:3.0:1786176747.389622:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176747.389627:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786176747.389632:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176747.389637:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176747.389643:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe66d80 x1872931145614720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176747.389657:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145614720/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176747.389658:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145615104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176747.389669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176747.389675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176747.389681:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145614720:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176747.389687:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176747.389689:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145614848:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176747.389697:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176747.389700:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176747.389705:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10481
00000800:00000100:2.0:1786176747.389710:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176747.389714:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176747.389720:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe67b80 x1872931145614848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176747.389723:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176747.389734:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176747.389737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145614848/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176747.389745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176747.389748:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176747.389753:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145614848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176747.389753:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145615232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176747.389764:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145614976:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176747.389776:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176747.389781:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176747.389783:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786176747.389789:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176747.389794:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10481
00000100:00080000:3.0:1786176747.389800:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176747.389805:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176747.389809:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe65500 x1872931145614976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176747.389813:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176747.389833:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145615360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176747.389834:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145614976/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176747.389863:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176747.389868:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176747.389872:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145614976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176747.389884:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145615104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176747.389934:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176747.389944:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe66a00 x1872931145615104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176747.389953:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145615104/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176747.389959:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176747.389964:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176747.389968:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145615104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176747.389975:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145615232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176747.389997:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176747.390009:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe64700 x1872931145615232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176747.390021:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145615232/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176747.390028:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176747.390030:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176747.390032:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145615232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176747.390036:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145615360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176747.390050:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176747.390057:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176747/real 1786176747]  req@ffff89d99fe64380 x1872931145615360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176747.390065:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145615360/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176747.390070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176747.390071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176747.390073:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145615360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176747.901037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176747.901121:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176748.413032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176748.924967:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176748.925043:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176749.437041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176749.949011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176749.949114:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176750.461002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176750.972980:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176750.973043:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176751.485045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176751.997065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176751.997143:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176752.508974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176752.509010:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176752.509025:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176752.509030:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509039:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10486
00000100:00080000:1.0:1786176752.509049:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176752.509058:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176752.509094:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145615488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176752.509121:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176752.509125:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176752.509127:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509132:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10486
00000100:00080000:1.0:1786176752.509137:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176752.509142:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176752.509148:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145615488:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786176752.509152:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176752.509169:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145615616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176752.509182:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176752.509186:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176752.509188:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509193:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10486
00000100:00080000:1.0:1786176752.509199:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786176752.509204:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176752.509205:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176752.509213:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176752.509227:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145615744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176752.509236:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176752.509238:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2fd500 x1872931145615488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176752.509239:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176752.509243:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509254:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10486
00000100:00080000:1.0:1786176752.509260:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176752.509261:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145615488/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176752.509268:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786176752.509274:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786176752.509277:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786176752.509280:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176752.509285:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145615488:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176752.509295:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145615872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176752.509306:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145615616:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176752.509313:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176752.509318:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176752.509321:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509327:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10486
00000800:00000100:2.0:1786176752.509328:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176752.509335:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176752.509342:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176752.509343:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2fc380 x1872931145615616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176752.509351:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176752.509356:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145615616/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176752.509364:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176752.509368:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145616000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176752.509378:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176752.509386:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145615616:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176752.509387:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176752.509394:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1786176752.509395:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145615744:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176752.509397:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509403:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10486
00000100:00080000:1.0:1786176752.509406:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176752.509410:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176752.509414:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176752.509419:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176752.509426:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145616128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176752.509431:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2fdf80 x1872931145615744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176752.509462:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176752.509468:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176752.509471:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509477:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10486
00000100:00100000:2.0:1786176752.509480:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145615744/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176752.509482:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176752.509489:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176752.509496:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786176752.509497:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176752.509502:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176752.509505:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145616256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176752.509509:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145615744:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176752.509516:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176752.509520:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176752.509521:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509525:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10486
00000100:00080000:1.0:1786176752.509528:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176752.509533:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176752.509534:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145615872:192.168.202.130@tcp:8:kworker.0
00000008:00100000:1.0:1786176752.509536:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176752.509547:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145616384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176752.509556:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176752.509558:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176752.509560:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176752.509563:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10486
00000800:00000100:2.0:1786176752.509568:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176752.509570:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176752.509575:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176752.509578:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176752.509583:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2ffb80 x1872931145615872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176752.509588:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145616512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176752.509599:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145615872/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176752.509606:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176752.509609:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176752.509612:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145615872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176752.509618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145616000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176752.509631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176752.509637:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2ff100 x1872931145616000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176752.509644:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145616000/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176752.509653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176752.509655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176752.509657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145616000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176752.509661:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145616128:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176752.509670:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176752.509675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2fd180 x1872931145616128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176752.509682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145616128/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176752.509687:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176752.509689:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176752.509690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145616128:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176752.509694:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145616256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176752.509703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176752.509708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2fed80 x1872931145616256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176752.509715:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145616256/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176752.509720:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176752.509721:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176752.509724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145616256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176752.509741:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145616384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176752.509761:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176752.509773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2fea00 x1872931145616384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176752.509784:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145616384/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176752.509790:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176752.509792:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176752.509794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145616384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176752.509798:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145616512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176752.509811:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176752.509817:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176752/real 1786176752]  req@ffff89d9ba2fdf80 x1872931145616512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176752.509825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145616512/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176752.509830:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176752.509831:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176752.509833:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145616512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176753.020993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176753.021074:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176753.532974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176754.045036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176754.045130:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176754.556989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176755.068983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176755.069047:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176755.580978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176756.093003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176756.093073:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176756.604977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176757.116955:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176757.117041:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176757.629004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176757.629050:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176757.629061:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176757.629067:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176757.629080:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00080000:1.0:1786176757.629094:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176757.629104:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176757.629157:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145616640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176757.629187:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176757.629191:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176757.629192:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176757.629195:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00080000:1.0:1786176757.629199:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176757.629203:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176757.629214:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176757.629225:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145616768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176757.629238:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176757.629239:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145616640:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176757.629246:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176757.629249:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176757.629261:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00080000:1.0:1786176757.629264:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176757.629267:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176757.629269:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176757.629293:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145616896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176757.629301:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176757.629304:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176757.629306:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176757.629309:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00080000:1.0:1786176757.629314:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176757.629317:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176757.629322:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176757.629335:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145617024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176757.629335:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176757.629347:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176757.629351:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176757.629352:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176757.629358:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00080000:1.0:1786176757.629362:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176757.629364:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176757.629369:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176757.629376:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145617152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176757.629383:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176757.629385:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176757.629387:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176757.629391:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00080000:1.0:1786176757.629394:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176757.629401:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2fc380 x1872931145616640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176757.629402:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176757.629412:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176757.629450:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145617280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176757.629450:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145616640/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176757.629514:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176757.629517:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176757.629522:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176757.629526:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176757.629526:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176757.629547:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00100000:2.0:1786176757.629548:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145616640:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176757.629560:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176757.629566:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176757.629573:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176757.629586:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145616768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176757.629587:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145617408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176757.629617:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176757.629620:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176757.629623:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176757.629630:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00080000:1.0:1786176757.629634:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786176757.629634:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176757.629644:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176757.629650:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176757.629655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2fd500 x1872931145616768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176757.629663:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145617536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176757.629684:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145616768/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176757.629686:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176757.629703:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176757.629710:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176757.629716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176757.629718:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10491
00000100:00080000:1.0:1786176757.629731:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176757.629732:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176757.629742:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176757.629743:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145616768:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786176757.629753:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176757.629760:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145616896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176757.629769:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145617664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176757.629790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176757.629835:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2ff800 x1872931145616896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176757.629845:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145616896/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176757.629851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176757.629853:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176757.629855:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145616896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176757.629860:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145617024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176757.629877:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176757.629885:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2fce00 x1872931145617024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176757.629892:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145617024/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176757.629916:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176757.629918:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176757.629921:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145617024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176757.629925:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145617152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176757.629938:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176757.629946:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2fd880 x1872931145617152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176757.629959:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145617152/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176757.629964:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176757.629966:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176757.629968:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145617152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176757.629972:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145617280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176757.629988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176757.629999:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2fe680 x1872931145617280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176757.630012:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145617280/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176757.630021:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176757.630025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176757.630028:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145617280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176757.630048:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145617408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176757.630064:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176757.630072:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2fe300 x1872931145617408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176757.630080:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145617408/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176757.630089:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176757.630092:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176757.630094:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145617408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176757.630098:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145617536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176757.630108:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176757.630114:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2fdc00 x1872931145617536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176757.630121:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145617536/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176757.630126:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176757.630128:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176757.630130:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145617536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176757.630134:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145617664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176757.630143:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176757.630149:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176757/real 1786176757]  req@ffff89d9ba2ff480 x1872931145617664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176757.630156:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145617664/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176757.630161:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176757.630162:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176757.630165:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145617664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176758.140990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176758.141084:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176758.652986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176759.165045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176759.165109:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176759.676971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176760.189007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176760.189076:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176760.700967:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176761.213039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176761.213111:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176761.724995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176762.236995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176762.237124:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176762.749050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176762.749059:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176762.749072:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176762.749076:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176762.749090:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:3.0:1786176762.749112:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176762.749121:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176762.749163:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145617792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176762.749207:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176762.749211:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176762.749214:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176762.749221:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:3.0:1786176762.749226:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176762.749232:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176762.749242:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145617792:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176762.749247:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176762.749272:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145617920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176762.749285:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176762.749289:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176762.749291:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176762.749297:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:3.0:1786176762.749301:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176762.749306:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176762.749312:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176762.749316:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176762.749330:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145618048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176762.749338:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176762.749341:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176762.749343:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176762.749346:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:3.0:1786176762.749349:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176762.749353:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176762.749358:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176762.749360:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe65f80 x1872931145617792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176762.749376:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145618176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176762.749383:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145617792/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176762.749392:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176762.749408:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176762.749412:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145617792:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176762.749438:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145617920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176762.749455:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176762.749465:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe64000 x1872931145617920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176762.749474:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176762.749478:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176762.749481:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145617920/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176762.749482:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176762.749491:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176762.749494:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176762.749496:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145617920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176762.749499:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145618048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176762.749511:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176762.749518:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe65880 x1872931145618048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176762.749525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145618048/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176762.749530:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176762.749532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176762.749534:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145618048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176762.749542:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145618176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176762.749564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176762.749572:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe66680 x1872931145618176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176762.749581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145618176/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176762.749586:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176762.749589:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176762.749592:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145618176:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176762.749606:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:3.0:1786176762.749610:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176762.749613:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176762.749618:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176762.749630:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145618304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176762.749708:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176762.749714:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176762.749717:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176762.749728:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:3.0:1786176762.749735:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176762.749738:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145618304:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176762.749745:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176762.749772:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176762.749785:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145618432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176762.749798:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176762.749802:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000800:00000100:1.0:1786176762.749806:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176762.749806:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176762.749814:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:3.0:1786176762.749820:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176762.749826:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176762.749831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe67480 x1872931145618304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176762.749833:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176762.749854:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145618560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176762.749857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145618304/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176762.749877:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176762.749879:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176762.749882:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176762.749886:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176762.749887:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176762.749893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145618304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176762.749951:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145618432:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176762.749982:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:3.0:1786176762.749989:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176762.749996:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176762.749997:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176762.750005:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176762.750013:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe67800 x1872931145618432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176762.750020:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145618688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176762.750055:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176762.750056:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145618432/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176762.750063:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176762.750067:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176762.750070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176762.750074:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10496
00000100:00080000:1.0:1786176762.750077:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176762.750080:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176762.750082:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145618432:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176762.750087:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176762.750092:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145618560:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176762.750093:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176762.750108:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145618816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176762.750116:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176762.750128:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe66300 x1872931145618560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176762.750137:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145618560/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176762.750144:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176762.750147:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176762.750149:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145618560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176762.750161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145618688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176762.750171:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176762.750177:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe64a80 x1872931145618688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176762.750185:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145618688/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176762.750194:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176762.750197:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176762.750199:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145618688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176762.750202:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145618816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176762.750212:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176762.750217:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176762/real 1786176762]  req@ffff89d99fe65180 x1872931145618816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176762.750224:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145618816/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176762.750229:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176762.750231:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176762.750233:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145618816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176763.261041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176763.261111:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176763.772995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176764.284964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176764.285068:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176764.797013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176765.308954:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176765.309080:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176765.820987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176766.333045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176766.333088:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176766.845017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176767.357012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176767.357083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176767.868977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176767.868985:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176767.868990:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176767.868994:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869003:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:3.0:1786176767.869011:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176767.869018:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176767.869058:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145618944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176767.869079:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176767.869082:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176767.869084:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869086:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:3.0:1786176767.869088:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176767.869091:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176767.869098:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176767.869109:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145619072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176767.869118:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176767.869119:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145618944:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176767.869121:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176767.869126:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869130:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:3.0:1786176767.869132:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176767.869134:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176767.869138:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176767.869147:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145619200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176767.869154:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176767.869156:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176767.869158:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869160:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:3.0:1786176767.869162:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176767.869164:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176767.869168:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176767.869175:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145619328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176767.869182:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176767.869188:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176767.869191:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176767.869193:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869197:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:3.0:1786176767.869200:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176767.869202:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176767.869205:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176767.869214:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145619456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176767.869220:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176767.869223:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe67100 x1872931145618944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176767.869224:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176767.869227:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869234:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:3.0:1786176767.869239:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176767.869244:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176767.869248:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176767.869252:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145618944/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176767.869259:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145619584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176767.869263:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176767.869270:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176767.869271:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176767.869277:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176767.869281:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145618944:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176767.869281:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869289:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:3.0:1786176767.869292:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176767.869295:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176767.869298:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176767.869304:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145619712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176767.869310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145619072:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176767.869314:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176767.869317:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176767.869319:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869324:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:3.0:1786176767.869328:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176767.869333:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176767.869334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176767.869339:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176767.869350:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe65180 x1872931145619072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176767.869352:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145619840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176767.869376:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176767.869378:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145619072/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176767.869380:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176767.869384:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176767.869392:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10502
00000100:00080000:1.0:1786176767.869395:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176767.869396:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176767.869402:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176767.869403:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176767.869409:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145619072:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176767.869409:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176767.869421:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145619200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176767.869421:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145619968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176767.869444:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176767.869455:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe64a80 x1872931145619200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176767.869463:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145619200/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176767.869468:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176767.869470:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176767.869472:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145619200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176767.869476:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145619328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176767.869486:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176767.869492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe66300 x1872931145619328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176767.869499:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145619328/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176767.869504:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176767.869506:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176767.869507:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145619328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176767.869511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145619456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176767.869520:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176767.869526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe67800 x1872931145619456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176767.869533:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145619456/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176767.869538:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176767.869539:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176767.869541:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145619456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176767.869544:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145619584:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176767.869553:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176767.869558:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe67480 x1872931145619584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176767.869565:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145619584/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176767.869574:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176767.869576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176767.869578:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145619584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176767.869591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145619712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176767.869601:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176767.869606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe66680 x1872931145619712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176767.869614:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145619712/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176767.869619:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176767.869620:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176767.869622:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145619712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176767.869625:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145619840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176767.869634:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176767.869640:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe65880 x1872931145619840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176767.869647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145619840/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176767.869652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176767.869654:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176767.869656:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145619840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176767.869660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145619968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176767.869669:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176767.869674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176767/real 1786176767]  req@ffff89d99fe64000 x1872931145619968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176767.869681:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145619968/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176767.869687:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176767.869688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176767.869690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145619968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176768.380986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176768.381051:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176768.893037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176769.405011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176769.405056:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176769.917055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176770.428967:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176770.429065:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176770.941013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176771.453006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176771.453108:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176771.965026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176772.477099:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176772.477167:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176772.988991:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176772.989000:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176772.989004:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176772.989011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176772.989014:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00080000:3.0:1786176772.989027:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176772.989036:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176772.989070:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145620096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176772.989094:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176772.989096:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176772.989098:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176772.989100:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00080000:3.0:1786176772.989103:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176772.989105:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176772.989113:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176772.989123:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145620224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176772.989132:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176772.989137:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145620096:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176772.989138:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176772.989143:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176772.989157:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00080000:3.0:1786176772.989159:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176772.989161:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176772.989165:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176772.989180:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145620352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176772.989187:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176772.989190:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176772.989192:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176772.989195:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00080000:3.0:1786176772.989198:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176772.989200:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176772.989206:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176772.989215:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145620480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176772.989221:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176772.989223:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176772.989224:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176772.989228:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00080000:3.0:1786176772.989230:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176772.989236:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176772.989239:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176772.989246:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176772.989257:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145620608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176772.989264:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176772.989266:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176772.989268:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176772.989270:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00080000:3.0:1786176772.989273:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176772.989277:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176772.989281:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176772.989296:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe65f80 x1872931145620096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176772.989300:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145620736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176772.989352:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176772.989354:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176772.989355:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176772.989365:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00100000:1.0:1786176772.989368:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145620096/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176772.989368:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176772.989377:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176772.989385:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176772.989402:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176772.989408:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145620864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176772.989411:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176772.989421:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145620096:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176772.989442:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176772.989446:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176772.989448:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176772.989453:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00080000:3.0:1786176772.989458:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176772.989462:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145620224:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176772.989465:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176772.989482:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176772.989500:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145620992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176772.989506:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176772.989521:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176772.989526:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe64380 x1872931145620224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176772.989527:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176772.989530:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176772.989547:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10507
00000100:00080000:3.0:1786176772.989553:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176772.989555:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145620224/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176772.989561:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176772.989574:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176772.989578:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176772.989579:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176772.989591:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145620224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176772.989597:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145621120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176772.989619:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145620352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176772.989647:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176772.989685:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe64700 x1872931145620352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176772.989695:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145620352/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176772.989701:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176772.989704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176772.989706:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145620352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176772.989711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145620480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176772.989727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176772.989734:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe66a00 x1872931145620480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176772.989743:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145620480/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176772.989748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176772.989750:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176772.989752:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145620480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176772.989756:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145620608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176772.989767:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176772.989773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe65500 x1872931145620608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176772.989780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145620608/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176772.989785:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176772.989787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176772.989789:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145620608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176772.989793:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145620736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176772.989803:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176772.989808:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe67b80 x1872931145620736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176772.989815:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145620736/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176772.989825:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176772.989827:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176772.989829:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145620736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176772.989833:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145620864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176772.989843:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176772.989848:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe66d80 x1872931145620864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176772.989856:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145620864/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176772.989861:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176772.989863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176772.989865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145620864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176772.989880:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145620992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176772.989891:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176772.989918:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe65f80 x1872931145620992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176772.989927:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145620992/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176772.989933:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176772.989935:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176772.989938:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145620992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176772.989942:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145621120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176772.989955:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176772.989962:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176772/real 1786176772]  req@ffff89d99fe64000 x1872931145621120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176772.989970:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145621120/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176797 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176772.989976:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176772.989978:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176772.989980:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145621120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176773.501053:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176773.501128:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176774.012989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176774.524972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176774.525069:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176775.037033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176775.548985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176775.549028:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176776.061074:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176776.573003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176776.573060:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176777.084971:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176777.597009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176777.597190:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176778.109021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176778.109036:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176778.109043:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176778.109048:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176778.109057:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:0.0:1786176778.109067:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176778.109075:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176778.109112:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145621248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176778.109139:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176778.109143:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176778.109145:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176778.109150:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:0.0:1786176778.109156:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176778.109161:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176778.109167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145621248:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176778.109171:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176778.109189:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145621376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176778.109207:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176778.109210:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176778.109212:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176778.109217:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:0.0:1786176778.109221:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176778.109225:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176778.109227:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176778.109233:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176778.109246:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145621504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176778.109257:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176778.109260:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176778.109262:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176778.109266:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:0.0:1786176778.109270:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176778.109275:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f0a80 x1872931145621248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176778.109279:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176778.109290:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176778.109298:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145621248/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176778.109306:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145621632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176778.109310:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176778.109319:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176778.109327:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176778.109327:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145621248:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176778.109337:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176778.109340:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176778.109346:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:0.0:1786176778.109351:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176778.109354:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145621376:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176778.109359:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176778.109367:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176778.109378:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176778.109383:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145621760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176778.109392:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f1180 x1872931145621376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176778.109398:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176778.109404:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786176778.109407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145621376/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176778.109409:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176778.109419:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:0.0:1786176778.109428:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176778.109429:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176778.109434:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176778.109440:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786176778.109442:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176778.109447:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145621376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176778.109457:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145621888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176778.109460:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145621504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176778.109476:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176778.109480:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176778.109482:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176778.109487:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:0.0:1786176778.109492:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176778.109497:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176778.109499:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176778.109506:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176778.109517:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f3480 x1872931145621504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176778.109520:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145622016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176778.109557:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145621504/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176778.109560:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176778.109568:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176778.109573:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176778.109575:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176778.109580:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:1.0:1786176778.109581:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176778.109588:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176778.109588:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145621504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176778.109597:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176778.109599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145621632:192.168.202.130@tcp:8:kworker.0
00000008:00100000:0.0:1786176778.109622:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176778.109639:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145622144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176778.109642:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176778.109655:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176778.109656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f3b80 x1872931145621632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176778.109666:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176778.109671:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176778.109675:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145621632/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176778.109678:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10512
00000100:00080000:0.0:1786176778.109685:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176778.109688:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176778.109693:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176778.109695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176778.109700:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145621632:192.168.202.130@tcp:8:kworker.0
00000008:00100000:0.0:1786176778.109701:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176778.109718:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145622272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176778.109719:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145621760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176778.109741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176778.109750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f0700 x1872931145621760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176778.109758:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145621760/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176778.109764:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176778.109766:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176778.109768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145621760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176778.109772:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145621888:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176778.109781:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176778.109787:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f2d80 x1872931145621888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176778.109794:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145621888/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176778.109800:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176778.109802:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176778.109804:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145621888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176778.109807:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145622016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176778.109817:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176778.109822:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f2a00 x1872931145622016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176778.109829:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145622016/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176778.109834:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176778.109836:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176778.109838:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145622016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176778.109841:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145622144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176778.109851:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176778.109856:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f2680 x1872931145622144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176778.109863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145622144/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176778.109868:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176778.109870:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176778.109873:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145622144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176778.109882:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145622272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176778.109892:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176778.109916:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176778/real 1786176778]  req@ffff89d9870f1880 x1872931145622272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176778.109924:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145622272/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176778.109930:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176778.109932:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176778.109934:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145622272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176778.620964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176778.621064:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176779.133027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176779.645025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176779.645102:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176780.157014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176780.669043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176780.669118:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176781.181050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176781.693028:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176781.693105:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176782.205033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176782.717046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176782.717099:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176783.229015:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176783.229033:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176783.229038:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176783.229052:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00100000:1.0:1786176783.229061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176783.229068:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176783.229090:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176783.229135:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145622400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176783.229162:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176783.229165:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176783.229166:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176783.229169:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00080000:0.0:1786176783.229173:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176783.229177:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176783.229185:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176783.229202:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145622400:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176783.229203:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145622528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176783.229217:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176783.229220:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176783.229222:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176783.229227:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00080000:0.0:1786176783.229231:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176783.229236:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176783.229241:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176783.229256:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145622656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176783.229266:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176783.229275:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176783.229278:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176783.229280:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176783.229284:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00080000:0.0:1786176783.229287:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176783.229290:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176783.229296:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176783.229305:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f1500 x1872931145622400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176783.229308:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145622784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176783.229333:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176783.229338:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145622400/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176783.229340:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176783.229344:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176783.229353:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00080000:1.0:1786176783.229353:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176783.229362:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176783.229362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176783.229370:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176783.229372:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145622400:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786176783.229378:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176783.229392:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145622912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176783.229401:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176783.229403:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145622528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176783.229404:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176783.229408:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176783.229414:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00080000:0.0:1786176783.229417:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176783.229420:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176783.229423:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176783.229432:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145623040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176783.229435:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176783.229444:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176783.229447:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176783.229449:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176783.229451:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f0e00 x1872931145622528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176783.229454:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00080000:0.0:1786176783.229460:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176783.229465:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176783.229469:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176783.229472:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145622528/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176783.229479:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145623168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176783.229496:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176783.229497:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176783.229503:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176783.229505:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176783.229507:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176783.229511:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00080000:0.0:1786176783.229514:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176783.229517:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145622528:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176783.229520:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176783.229526:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176783.229532:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145622656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176783.229535:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145623296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176783.229548:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176783.229564:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176783.229567:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176783.229570:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176783.229574:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10517
00000100:00080000:0.0:1786176783.229581:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176783.229586:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176783.229586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f3100 x1872931145622656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176783.229594:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176783.229604:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145622656/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176783.229610:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145623424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176783.229615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176783.229623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176783.229628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145622656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176783.229633:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145622784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176783.229649:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176783.229656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f1880 x1872931145622784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176783.229664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145622784/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176783.229669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176783.229671:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176783.229673:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145622784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176783.229690:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145622912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176783.229702:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176783.229709:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f2680 x1872931145622912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176783.229716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145622912/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176783.229721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176783.229724:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176783.229726:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145622912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176783.229729:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145623040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176783.229739:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176783.229745:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f2a00 x1872931145623040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176783.229752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145623040/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176783.229757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176783.229759:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176783.229761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145623040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176783.229765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145623168:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176783.229774:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176783.229780:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f2d80 x1872931145623168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176783.229787:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145623168/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176783.229792:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176783.229794:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176783.229795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145623168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176783.229798:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145623296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176783.229808:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176783.229813:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f0700 x1872931145623296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176783.229821:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145623296/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176783.229829:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176783.229832:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176783.229836:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145623296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176783.229842:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145623424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176783.229861:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176783.229873:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176783/real 1786176783]  req@ffff89d9870f3b80 x1872931145623424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176783.229885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145623424/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176783.229891:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176783.229893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176783.229919:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145623424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176783.741000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176783.741092:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176784.253028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176784.765027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176784.765097:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176785.276995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176785.789000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176785.789051:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176786.301004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176786.813016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176786.813072:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176787.324991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176787.836964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176787.837031:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176788.348979:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176788.348983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176788.348992:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176788.348997:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176788.349007:0:185140:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00080000:0.0:1786176788.349017:0:185140:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176788.349024:0:185140:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176788.349061:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145623552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176788.349090:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176788.349093:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176788.349095:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176788.349098:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00080000:0.0:1786176788.349102:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176788.349105:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176788.349113:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176788.349126:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145623680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176788.349129:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145623552:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176788.349137:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176788.349140:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176788.349141:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176788.349149:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00080000:0.0:1786176788.349152:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176788.349155:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176788.349159:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176788.349169:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145623808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176788.349176:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176788.349179:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176788.349180:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176788.349183:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00080000:0.0:1786176788.349195:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176788.349199:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176788.349205:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176788.349221:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145623936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176788.349232:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176788.349236:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176788.349239:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145623680:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176788.349240:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176788.349249:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00080000:0.0:1786176788.349252:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176788.349256:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176788.349261:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176788.349272:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145623808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176788.349274:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145624064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176788.349285:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176788.349287:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176788.349289:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176788.349293:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00100000:1.0:1786176788.349296:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145623936:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176788.349298:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176788.349304:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176788.349308:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176788.349317:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145624192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176788.349324:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176788.349327:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176788.349328:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176788.349332:0:185140:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00080000:0.0:1786176788.349335:0:185140:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176788.349336:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145624064:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176788.349340:0:185140:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176788.349348:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176788.349357:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145624320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176788.349365:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176788.349368:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176788.349370:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176788.349373:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145624192:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176788.349376:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00080000:0.0:1786176788.349383:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176788.349388:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176788.349394:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176788.349399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145624320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176788.349409:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145624448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176788.349429:0:185140:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176788.349433:0:185140:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176788.349435:0:185140:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176788.349436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145624448:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176788.349442:0:185140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10522
00000100:00080000:0.0:1786176788.349447:0:185140:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176788.349451:0:185140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176788.349457:0:185140:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176788.349467:0:185140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145624576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176788.349499:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145624576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176788.861018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176788.861079:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176789.372981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176789.884967:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176789.885005:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176790.397022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176790.909036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176790.909085:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176791.421059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786176791.421315:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786176791.421374:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786176791.421396:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176791.421510:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786176791.421528:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176791.421539:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176791.421548:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176791.421557:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176791.421567:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176791.421575:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176791.421583:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786176791.421688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f1880 x1872931145624576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.421719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145624576/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.421736:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.421742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.421748:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145624576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176791.421759:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f2680 x1872931145624448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.421774:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145624448/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.421783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.421787:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.421791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145624448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176791.421799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f2a00 x1872931145624320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.421813:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145624320/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.421820:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.421824:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.421828:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145624320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176791.421835:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f0700 x1872931145624064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.421847:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145624064/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.421855:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.421859:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.421862:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145624064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176791.421869:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f2d80 x1872931145624192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.421880:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145624192/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.421887:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.421891:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.421894:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145624192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176791.421931:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f1180 x1872931145623680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.421944:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145623680/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.421952:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.421956:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.421959:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145623680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176791.421967:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f0a80 x1872931145623808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.421981:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145623808/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.421990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.421994:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.421999:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145623808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176791.422007:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f3b80 x1872931145623936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.422022:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145623936/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.422031:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.422035:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.422040:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145623936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176791.422047:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176788/real 1786176791]  req@ffff89d9870f3480 x1872931145623552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176791.422062:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145623552/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176791.422070:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176791.422074:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176791.422078:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145623552:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176791.933009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176791.933081:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176792.445017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176792.957097:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176792.957142:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786176793.469006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176793.469006:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176793.469017:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176793.469022:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176793.469033:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00080000:1.0:1786176793.469041:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176793.469048:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176793.469081:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145624704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176793.469104:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176793.469107:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176793.469108:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176793.469111:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00080000:1.0:1786176793.469114:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176793.469117:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176793.469125:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176793.469135:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145624832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176793.469143:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176793.469147:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176793.469149:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176793.469149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145624704:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176793.469156:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00080000:1.0:1786176793.469160:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176793.469163:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176793.469166:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176793.469175:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145624960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176793.469185:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176793.469188:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176793.469190:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176793.469195:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00080000:1.0:1786176793.469199:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176793.469204:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176793.469210:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786176793.469221:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176793.469224:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145625088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176793.469235:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176793.469238:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176793.469239:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176793.469243:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00080000:1.0:1786176793.469247:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176793.469252:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176793.469257:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176793.469269:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145625216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176793.469280:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176793.469283:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2fc700 x1872931145624704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176793.469284:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176793.469288:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176793.469298:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00080000:1.0:1786176793.469305:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176793.469311:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176793.469317:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176793.469319:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145624704/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176793.469333:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176793.469339:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145625344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176793.469340:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176793.469349:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145624704:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176793.469359:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176793.469363:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176793.469366:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176793.469381:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00100000:2.0:1786176793.469383:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145624832:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176793.469388:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176793.469395:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176793.469402:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176793.469417:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176793.469426:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145625472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176793.469435:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2ff480 x1872931145624832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176793.469487:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145624832/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176793.469502:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176793.469504:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176793.469507:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176793.469512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176793.469513:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176793.469521:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145624832:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176793.469522:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00080000:1.0:1786176793.469531:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176793.469536:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145624960:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176793.469539:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176793.469550:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176793.469565:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145625600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176793.469576:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176793.469579:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176793.469584:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176793.469586:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176793.469592:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10527
00000100:00100000:2.0:1786176793.469595:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2fdc00 x1872931145624960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176793.469598:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176793.469608:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176793.469615:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176793.469618:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145624960/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176793.469629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786176793.469631:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145625728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176793.469635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176793.469641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145624960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176793.469656:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145625088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176793.469681:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176793.469693:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2fe300 x1872931145625088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176793.469704:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145625088/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176793.469716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176793.469719:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176793.469723:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145625088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176793.469728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145625216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176793.469747:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176793.469758:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2fe680 x1872931145625216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176793.469770:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145625216/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176793.469778:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176793.469782:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176793.469785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145625216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176793.469791:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145625344:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176793.469811:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176793.469824:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2fd880 x1872931145625344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176793.469835:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145625344/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176793.469843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176793.469845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176793.469849:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145625344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176793.469869:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145625472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176793.469890:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176793.469924:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2fce00 x1872931145625472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176793.469939:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145625472/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176793.469946:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176793.469949:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176793.469952:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145625472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176793.469958:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145625600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176793.469977:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176793.469988:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2ff800 x1872931145625600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176793.469999:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145625600/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176793.470008:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176793.470011:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176793.470015:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145625600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176793.470020:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145625728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176793.470039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176793.470050:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176793/real 1786176793]  req@ffff89d9ba2fd500 x1872931145625728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176793.470061:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145625728/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176793.470069:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176793.470071:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176793.470075:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145625728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176793.980992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176793.981042:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176794.492995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176795.005000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176795.005073:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176795.517037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176796.028950:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176796.029081:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176796.540998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:3.0:1786176797.053172:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176797.053226:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786176797.565039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176798.077040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176798.077124:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176798.589033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176798.589114:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589119:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176798.589124:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176798.589136:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589149:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176798.589157:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176798.589200:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145625856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176798.589224:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589227:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176798.589229:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176798.589232:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589236:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176798.589240:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176798.589252:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176798.589263:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145625856:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176798.589275:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145625984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176798.589289:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589292:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176798.589296:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176798.589302:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589308:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176798.589312:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176798.589317:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176798.589329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145626112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176798.589344:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589348:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176798.589350:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786176798.589361:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176798.589364:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589374:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176798.589381:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176798.589388:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176798.589418:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145626240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176798.589427:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589433:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1786176798.589435:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f3100 x1872931145625856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176798.589436:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176798.589444:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589448:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176798.589454:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176798.589463:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176798.589487:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145625856/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176798.589488:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145626368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176798.589521:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589530:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176798.589531:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176798.589538:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589541:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176798.589543:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176798.589546:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176798.589551:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786176798.589554:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176798.589565:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145626496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176798.589567:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145625856:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176798.589592:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589595:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176798.589596:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176798.589599:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589604:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176798.589608:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176798.589611:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176798.589627:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145626624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176798.589628:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145625984:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176798.589653:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589657:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176798.589659:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176798.589665:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589672:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176798.589676:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176798.589680:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176798.589688:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145626752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176798.589695:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176798.589709:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176798.589713:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176798.589716:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176798.589721:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10532
00000100:00080000:0.0:1786176798.589725:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176798.589731:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176798.589738:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176798.589738:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f0e00 x1872931145625984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176798.589761:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145626880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176798.589780:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145625984/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176798.589801:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176798.589806:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176798.589811:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145625984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176798.589822:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145626112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176798.589853:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176798.589875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f1500 x1872931145626112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176798.589893:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145626112/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176798.589945:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176798.589952:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176798.589956:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145626112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176798.589963:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145626240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176798.589988:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176798.590001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f3480 x1872931145626240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176798.590014:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145626240/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176798.590022:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176798.590026:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176798.590030:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145626240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176798.590037:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145626368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176798.590054:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176798.590065:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f3b80 x1872931145626368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176798.590077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145626368/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176798.590086:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176798.590089:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176798.590093:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145626368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176798.590099:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145626496:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176798.590116:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176798.590126:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f0a80 x1872931145626496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176798.590139:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145626496/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176798.590148:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176798.590151:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176798.590155:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145626496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176798.590176:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145626624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176798.590197:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176798.590209:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f1180 x1872931145626624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176798.590221:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145626624/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176798.590228:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176798.590231:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176798.590235:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145626624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176798.590241:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145626752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176798.590260:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176798.590272:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f2d80 x1872931145626752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176798.590283:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145626752/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176798.590291:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176798.590294:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176798.590297:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145626752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176798.590303:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145626880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176798.590322:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176798.590333:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176798/real 1786176798]  req@ffff89d9870f0700 x1872931145626880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176798.590344:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145626880/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176798.590353:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176798.590356:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176798.590359:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145626880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176799.101022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176799.101116:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176799.613019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176800.125020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176800.125090:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176800.636987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176801.149022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176801.149042:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176801.661000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176802.173032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176802.173126:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176802.685039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176803.197038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176803.197127:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176803.709050:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176803.709089:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176803.709098:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176803.709103:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709115:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10537
00000100:00080000:1.0:1786176803.709125:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176803.709143:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176803.709181:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145627008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176803.709215:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176803.709219:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176803.709222:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709226:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10537
00000100:00080000:1.0:1786176803.709231:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176803.709243:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176803.709253:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176803.709267:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145627008:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176803.709281:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145627136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176803.709296:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176803.709300:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176803.709302:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709307:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10537
00000100:00080000:1.0:1786176803.709311:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176803.709315:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176803.709322:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176803.709336:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145627264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176803.709347:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176803.709351:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176803.709370:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709379:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10537
00000800:00000100:2.0:1786176803.709382:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176803.709389:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176803.709396:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176803.709404:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176803.709433:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145627392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176803.709444:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176803.709449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2fc380 x1872931145627008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176803.709451:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176803.709455:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709470:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10537
00000100:00080000:1.0:1786176803.709480:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176803.709487:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176803.709492:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176803.709496:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145627008/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176803.709511:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145627520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176803.709514:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.709525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.709536:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145627008:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176803.709537:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176803.709549:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176803.709552:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709558:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10537
00000100:00080000:1.0:1786176803.709562:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176803.709567:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176803.709573:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176803.709587:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145627648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176803.709591:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145627136:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176803.709618:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176803.709622:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176803.709625:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709633:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10537
00000100:00080000:1.0:1786176803.709640:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786176803.709645:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176803.709651:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176803.709660:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176803.709674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2fdf80 x1872931145627136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176803.709680:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145627776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176803.709696:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176803.709702:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176803.709707:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709722:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10537
00000100:00080000:1.0:1786176803.709727:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176803.709729:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145627136/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176803.709736:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176803.709749:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786176803.709753:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.709762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.709768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145627136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176803.709772:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145627904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176803.709782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145627264:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176803.709806:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176803.709810:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176803.709813:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176803.709822:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10537
00000800:00000100:2.0:1786176803.709827:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176803.709833:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176803.709841:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176803.709847:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176803.709849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2fea00 x1872931145627264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176803.709865:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145628032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176803.709870:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145627264/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176803.709882:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.709893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.709925:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145627264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176803.709934:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145627392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176803.709963:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176803.709979:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2fed80 x1872931145627392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176803.709993:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145627392/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176803.710002:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.710005:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.710008:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145627392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176803.710015:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145627520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176803.710035:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176803.710046:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2fd180 x1872931145627520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176803.710059:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145627520/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176803.710067:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.710070:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.710074:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145627520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176803.710095:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145627648:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176803.710115:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176803.710127:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2ff100 x1872931145627648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176803.710139:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145627648/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176803.710147:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.710151:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.710155:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145627648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176803.710161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145627776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176803.710181:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176803.710192:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2ffb80 x1872931145627776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176803.710203:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145627776/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176803.710217:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.710220:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.710224:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145627776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176803.710230:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145627904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176803.710250:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176803.710262:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2fc380 x1872931145627904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176803.710274:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145627904/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176803.710282:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.710285:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.710289:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145627904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176803.710296:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145628032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176803.710316:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176803.710328:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176803/real 1786176803]  req@ffff89d9ba2fd500 x1872931145628032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176803.710339:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145628032/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176803.710348:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176803.710351:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176803.710369:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145628032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176804.221039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176804.221110:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176804.733023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176805.245025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176805.245114:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176805.757007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176806.269040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176806.269109:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176806.781003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176807.292960:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176807.293093:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176807.805016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176808.316968:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176808.317112:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786176808.829021:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176808.829032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176808.829032:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176808.829039:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176808.829049:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829058:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176808.829065:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176808.829102:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145628160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176808.829126:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176808.829129:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176808.829130:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176808.829133:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829135:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176808.829139:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176808.829147:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176808.829156:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145628288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176808.829164:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176808.829168:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:2.0:1786176808.829169:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145628160:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176808.829170:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176808.829177:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829181:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176808.829184:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176808.829187:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176808.829194:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145628416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176808.829201:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176808.829203:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176808.829204:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176808.829207:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829209:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176808.829211:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176808.829214:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176808.829221:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145628544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176808.829226:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176808.829229:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176808.829230:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176808.829233:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829235:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176808.829238:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176808.829240:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176808.829248:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145628672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176808.829256:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176808.829265:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176808.829268:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176808.829269:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176808.829273:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829275:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176808.829278:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176808.829282:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176808.829290:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145628800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176808.829296:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176808.829299:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176808.829300:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176808.829316:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829320:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176808.829325:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2ff800 x1872931145628160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176808.829326:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176808.829333:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176808.829349:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145628928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176808.829357:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145628160/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176808.829358:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176808.829365:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176808.829368:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176808.829377:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829382:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176808.829384:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176808.829385:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176808.829395:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786176808.829396:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829404:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145628160:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176808.829411:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145629056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176808.829423:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176808.829427:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176808.829429:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176808.829434:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145628288:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176808.829437:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10543
00000100:00080000:1.0:1786176808.829446:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176808.829450:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176808.829454:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176808.829465:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145629184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176808.829473:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176808.829494:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2fce00 x1872931145628288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176808.829508:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145628288/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176808.829518:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176808.829522:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829526:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145628288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176808.829532:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145628416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176808.829550:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176808.829561:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2fd880 x1872931145628416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176808.829572:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145628416/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176808.829580:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176808.829584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829587:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145628416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176808.829603:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145628544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176808.829622:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176808.829633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2fe680 x1872931145628544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176808.829645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145628544/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176808.829653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176808.829656:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145628544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176808.829666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145628672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176808.829681:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176808.829691:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2fe300 x1872931145628672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176808.829703:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145628672/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176808.829712:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176808.829715:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145628672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176808.829725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145628800:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176808.829741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176808.829750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2fdc00 x1872931145628800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176808.829761:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145628800/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176808.829769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176808.829772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145628800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176808.829781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145628928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176808.829799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176808.829811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2ff480 x1872931145628928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176808.829823:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145628928/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176808.829831:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176808.829834:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829837:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145628928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176808.829844:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145629056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176808.829863:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176808.829875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2fc700 x1872931145629056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176808.829887:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145629056/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176808.829918:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176808.829922:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829924:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145629056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176808.829946:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145629184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176808.829962:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176808.829970:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176808/real 1786176808]  req@ffff89d9ba2ff800 x1872931145629184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176808.829978:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145629184/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176808.829983:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176808.829985:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176808.829987:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145629184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176809.340987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176809.341043:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176809.853005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176810.365013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176810.365104:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176810.877061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176811.389003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176811.389085:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176811.901054:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176812.412996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176812.413074:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176812.925039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176813.437003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176813.437135:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176813.949016:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176813.949024:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176813.949028:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176813.949037:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949046:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949053:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176813.949057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176813.949089:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145629312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176813.949107:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176813.949110:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176813.949112:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176813.949116:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949118:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949121:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176813.949129:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176813.949140:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145629440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176813.949153:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176813.949156:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176813.949159:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176813.949167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145629312:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176813.949172:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949182:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949189:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176813.949196:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176813.949207:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145629568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176813.949215:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176813.949217:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176813.949219:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176813.949221:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949224:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949226:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176813.949231:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176813.949241:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145629696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176813.949247:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176813.949251:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176813.949252:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176813.949268:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949296:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949299:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176813.949303:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176813.949313:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145629824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176813.949322:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786176813.949326:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176813.949333:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176813.949336:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176813.949340:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949343:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949347:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176813.949351:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176813.949360:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145629952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176813.949367:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176813.949369:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176813.949372:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176813.949374:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949377:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949379:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176813.949384:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176813.949390:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145630080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176813.949396:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176813.949398:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176813.949400:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176813.949402:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949403:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949406:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176813.949411:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176813.949419:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe65880 x1872931145629312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176813.949422:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145630208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176813.949461:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176813.949470:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176813.949476:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176813.949480:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10548
00000100:00080000:3.0:1786176813.949483:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176813.949486:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176813.949490:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176813.949497:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145629312/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176813.949502:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145630336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176813.949580:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.949589:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.949597:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145629312:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176813.949633:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145629440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176813.949669:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176813.949687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe66680 x1872931145629440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176813.949702:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145629440/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176813.949712:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.949716:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.949720:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145629440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176813.949728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145629568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176813.949753:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176813.949769:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe67480 x1872931145629568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176813.949783:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145629568/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176813.949792:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.949797:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.949801:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145629568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176813.949808:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145629696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176813.949833:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176813.949847:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe67800 x1872931145629696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176813.949861:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145629696/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176813.949870:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.949874:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.949878:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145629696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176813.949886:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145629824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176813.949942:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176813.949957:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe66300 x1872931145629824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176813.949971:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145629824/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176813.949981:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.949985:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.949988:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145629824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176813.949996:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145629952:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176813.950021:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176813.950035:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe64a80 x1872931145629952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176813.950048:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145629952/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176813.950057:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.950060:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.950064:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145629952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176813.950072:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145630080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176813.950095:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176813.950109:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe65180 x1872931145630080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176813.950123:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145630080/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176813.950132:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.950136:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.950140:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145630080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176813.950148:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145630208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176813.950172:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176813.950186:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe67100 x1872931145630208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176813.950199:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145630208/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176813.950208:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.950212:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.950216:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145630208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176813.950224:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145630336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176813.950247:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176813.950277:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176813/real 1786176813]  req@ffff89d99fe64000 x1872931145630336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176813.950291:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145630336/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176813.950301:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176813.950305:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176813.950309:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145630336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176814.461003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176814.461076:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176814.973004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176815.484996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176815.485126:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176815.996991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176816.509013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176816.509078:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176817.021034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176817.532960:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176817.533026:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176818.044979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176818.557027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176818.557097:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176819.068995:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176819.069004:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176819.069008:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069017:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00080000:3.0:1786176819.069026:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176819.069033:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176819.069049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176819.069065:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145630464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176819.069088:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176819.069091:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176819.069092:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069095:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00080000:3.0:1786176819.069097:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176819.069099:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176819.069107:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176819.069116:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145630592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176819.069124:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176819.069126:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176819.069128:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069133:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00100000:2.0:1786176819.069134:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145630464:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176819.069135:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176819.069141:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176819.069147:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176819.069156:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145630720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176819.069163:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176819.069165:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176819.069167:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069169:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00080000:3.0:1786176819.069171:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176819.069173:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176819.069176:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176819.069184:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145630848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176819.069189:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176819.069191:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176819.069193:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069196:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00080000:3.0:1786176819.069199:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176819.069201:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176819.069215:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176819.069226:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145630976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176819.069232:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176819.069238:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176819.069241:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176819.069243:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069246:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00080000:3.0:1786176819.069249:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176819.069252:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176819.069256:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176819.069264:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145631104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176819.069270:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176819.069273:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176819.069274:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069277:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00080000:3.0:1786176819.069278:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176819.069281:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176819.069285:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176819.069288:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe65f80 x1872931145630464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176819.069298:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145631232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176819.069312:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176819.069318:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145630464/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176819.069318:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176819.069323:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069333:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00080000:2.0:1786176819.069341:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176819.069341:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176819.069349:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786176819.069351:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786176819.069355:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176819.069360:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145630464:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176819.069370:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145631360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176819.069378:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176819.069380:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176819.069382:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176819.069385:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10553
00000100:00080000:3.0:1786176819.069388:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176819.069391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145630592:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176819.069394:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176819.069400:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176819.069419:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145631488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176819.069428:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176819.069448:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe66d80 x1872931145630592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176819.069464:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145630592/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176819.069474:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176819.069477:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176819.069481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145630592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176819.069487:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145630720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176819.069510:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176819.069523:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe67b80 x1872931145630720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176819.069535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145630720/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176819.069544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176819.069547:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176819.069551:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145630720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176819.069557:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145630848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176819.069578:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176819.069592:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe65500 x1872931145630848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176819.069605:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145630848/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176819.069613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176819.069616:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176819.069620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145630848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176819.069626:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145630976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176819.069644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176819.069655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe66a00 x1872931145630976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176819.069667:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145630976/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176819.069676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176819.069680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176819.069684:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145630976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176819.069690:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145631104:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176819.069709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176819.069720:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe64700 x1872931145631104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176819.069733:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145631104/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176819.069741:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176819.069745:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176819.069748:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145631104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176819.069754:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145631232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176819.069772:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176819.069783:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe64380 x1872931145631232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176819.069794:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145631232/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176819.069802:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176819.069805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176819.069810:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145631232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176819.069816:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145631360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176819.069836:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176819.069849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe64000 x1872931145631360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176819.069861:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145631360/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176819.069869:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176819.069872:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176819.069875:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145631360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176819.069919:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145631488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176819.069941:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176819.069953:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176819/real 1786176819]  req@ffff89d99fe67100 x1872931145631488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176819.069965:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145631488/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176819.069974:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176819.069977:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176819.069981:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145631488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176819.581013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176819.581074:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176820.092982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176820.605032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176820.605119:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176821.116994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176821.629006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176821.629074:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176822.140991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176822.652978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176822.653081:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176823.164982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176823.677019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176823.677087:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176824.188974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176824.188977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176824.188984:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176824.188988:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176824.188998:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:3.0:1786176824.189008:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176824.189015:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176824.189052:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145631616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176824.189080:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176824.189082:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176824.189084:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176824.189087:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:3.0:1786176824.189090:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176824.189093:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176824.189101:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176824.189110:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145631744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176824.189118:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176824.189120:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145631616:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176824.189122:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176824.189125:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176824.189132:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:3.0:1786176824.189134:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176824.189136:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176824.189140:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176824.189149:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145631872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176824.189170:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176824.189173:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176824.189175:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176824.189178:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:3.0:1786176824.189184:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176824.189187:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176824.189191:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786176824.189198:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176824.189203:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145632000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176824.189211:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176824.189214:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176824.189215:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176824.189218:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:3.0:1786176824.189220:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176824.189222:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176824.189225:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176824.189233:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145632128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176824.189239:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176824.189241:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176824.189242:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176824.189244:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:3.0:1786176824.189246:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176824.189248:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176824.189253:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe65180 x1872931145631616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176824.189256:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176824.189268:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145632256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176824.189276:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145631616/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176824.189288:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176824.189293:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176824.189295:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176824.189297:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176824.189301:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:2.0:1786176824.189305:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176824.189306:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176824.189314:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145631616:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176824.189314:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176824.189320:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176824.189329:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145632384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176824.189335:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176824.189337:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176824.189339:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176824.189342:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145631744:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176824.189345:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:3.0:1786176824.189350:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176824.189352:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176824.189355:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176824.189364:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145632512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176824.189371:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176824.189380:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176824.189384:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176824.189385:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176824.189389:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe64a80 x1872931145631744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176824.189392:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10558
00000100:00080000:3.0:1786176824.189399:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176824.189404:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176824.189409:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176824.189410:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145631744/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176824.189418:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145632640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176824.189419:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176824.189428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176824.189435:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145631744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176824.189444:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145631872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176824.189461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176824.189469:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe66300 x1872931145631872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176824.189477:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145631872/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176824.189487:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176824.189490:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176824.189492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145631872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176824.189495:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145632000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176824.189506:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176824.189511:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe67800 x1872931145632000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176824.189518:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145632000/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176824.189524:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176824.189525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176824.189527:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145632000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176824.189530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145632128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176824.189540:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176824.189545:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe67480 x1872931145632128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176824.189552:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145632128/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176824.189557:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176824.189559:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176824.189561:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145632128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176824.189565:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145632256:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176824.189575:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176824.189584:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe66680 x1872931145632256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176824.189596:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145632256/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176824.189604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176824.189607:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176824.189611:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145632256:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176824.189627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145632384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176824.189646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176824.189655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe65880 x1872931145632384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176824.189663:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145632384/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176824.189668:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176824.189670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176824.189672:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145632384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176824.189686:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145632512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176824.189697:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176824.189703:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe65180 x1872931145632512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176824.189711:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145632512/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176824.189716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176824.189718:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176824.189720:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145632512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176824.189723:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145632640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176824.189733:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176824.189738:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176824/real 1786176824]  req@ffff89d99fe67100 x1872931145632640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176824.189745:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145632640/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176824.189750:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176824.189752:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176824.189754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145632640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176824.700992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176824.701282:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176825.213036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176825.725034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176825.725109:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176826.237105:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176826.748981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176826.749105:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176827.261040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176827.773012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176827.773081:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176828.285008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176828.796963:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176828.797051:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176829.309014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176829.309022:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176829.309026:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176829.309035:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10563
00000100:00080000:3.0:1786176829.309043:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176829.309047:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176829.309051:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176829.309087:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145632768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176829.309134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176829.309138:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176829.309140:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176829.309143:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10563
00000100:00100000:2.0:1786176829.309148:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145632768:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176829.309148:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176829.309157:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176829.309168:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176829.309185:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145632896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176829.309198:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176829.309202:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176829.309204:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176829.309209:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10563
00000800:00000100:2.0:1786176829.309213:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176829.309216:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176829.309223:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176829.309228:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176829.309240:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145633024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176829.309247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176829.309252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe64000 x1872931145632768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176829.309252:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176829.309256:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176829.309263:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10563
00000100:00080000:3.0:1786176829.309269:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176829.309274:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176829.309278:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176829.309282:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145632768/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176829.309290:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145633152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176829.309298:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176829.309300:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176829.309304:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176829.309305:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176829.309307:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176829.309312:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145632768:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176829.309314:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10563
00000100:00080000:3.0:1786176829.309320:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176829.309323:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176829.309326:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176829.309332:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145633280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176829.309339:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145632896:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176829.309340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176829.309347:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176829.309348:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176829.309352:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10563
00000100:00080000:3.0:1786176829.309354:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176829.309357:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176829.309361:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176829.309366:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176829.309370:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145633408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176829.309378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176829.309379:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe64380 x1872931145632896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176829.309389:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176829.309393:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176829.309399:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145632896/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176829.309402:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10563
00000100:00080000:3.0:1786176829.309410:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176829.309412:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176829.309417:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176829.309424:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786176829.309428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176829.309433:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145632896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176829.309439:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145633536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176829.309441:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145633024:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176829.309455:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176829.309458:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176829.309460:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176829.309464:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10563
00000800:00000100:2.0:1786176829.309469:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176829.309471:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176829.309476:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176829.309481:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176829.309482:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe64700 x1872931145633024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176829.309493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145633664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176829.309496:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145633024/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176829.309512:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176829.309516:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176829.309516:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176829.309520:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176829.309523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176829.309526:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10563
00000100:00080000:3.0:1786176829.309530:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176829.309531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145633024:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176829.309535:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176829.309541:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176829.309543:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145633152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176829.309550:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145633792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176829.309563:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176829.309573:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe66a00 x1872931145633152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176829.309581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145633152/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176829.309586:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176829.309588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176829.309590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145633152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176829.309599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145633280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176829.309610:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176829.309616:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe65500 x1872931145633280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176829.309623:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145633280/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176829.309628:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176829.309630:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176829.309631:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145633280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176829.309635:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145633408:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176829.309645:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176829.309651:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe67b80 x1872931145633408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176829.309659:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145633408/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176829.309664:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176829.309665:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176829.309667:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145633408:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176829.309670:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145633536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176829.309679:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176829.309685:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe66d80 x1872931145633536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176829.309692:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145633536/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176829.309697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176829.309699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176829.309701:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145633536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176829.309704:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145633664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176829.309713:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176829.309719:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe65f80 x1872931145633664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176829.309725:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145633664/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176829.309734:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176829.309736:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176829.309738:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145633664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176829.309741:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145633792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176829.309750:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176829.309755:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176829/real 1786176829]  req@ffff89d99fe64000 x1872931145633792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176829.309762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145633792/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176829.309768:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176829.309770:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176829.309771:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145633792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176829.821007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176829.821090:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176830.332988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176830.844975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176830.845031:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176831.356973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176831.868989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176831.869070:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176832.381126:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176832.892977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176832.893113:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176833.404996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176833.917017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176833.917095:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176834.429016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176834.429022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176834.429030:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176834.429034:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176834.429044:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00080000:3.0:1786176834.429055:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176834.429080:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176834.429116:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145633920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176834.429147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176834.429152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176834.429154:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176834.429160:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00080000:3.0:1786176834.429165:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176834.429170:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429178:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145633920:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786176834.429181:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176834.429198:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145634048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176834.429210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176834.429213:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176834.429216:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176834.429221:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00080000:3.0:1786176834.429226:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176834.429231:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786176834.429236:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176834.429238:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176834.429257:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145634176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176834.429269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176834.429273:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176834.429275:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176834.429280:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe67100 x1872931145633920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176834.429283:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00080000:3.0:1786176834.429292:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176834.429299:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429301:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145633920/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176834.429307:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1786176834.429314:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176834.429318:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176834.429321:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145633920:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176834.429329:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145634304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176834.429342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176834.429346:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145634048:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176834.429349:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176834.429354:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176834.429360:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00080000:3.0:1786176834.429365:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786176834.429369:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176834.429374:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429381:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe65180 x1872931145634048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176834.429381:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176834.429394:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145634048/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176834.429401:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145634432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176834.429403:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176834.429410:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176834.429417:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145634048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176834.429427:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145634176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176834.429430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176834.429435:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176834.429438:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786176834.429443:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176834.429448:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00100000:2.0:1786176834.429453:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe65880 x1872931145634176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176834.429455:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176834.429465:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429468:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145634176/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176834.429475:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786176834.429477:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176834.429483:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176834.429485:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145634176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176834.429491:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145634304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176834.429496:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145634560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176834.429507:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176834.429512:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176834.429517:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe66680 x1872931145634304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176834.429519:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176834.429524:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176834.429532:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145634304/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176834.429534:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00080000:3.0:1786176834.429543:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176834.429544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176834.429547:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176834.429549:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145634304:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176834.429559:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429563:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145634432:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786176834.429568:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786176834.429579:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176834.429588:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145634688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176834.429590:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe67480 x1872931145634432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176834.429619:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145634432/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176834.429624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176834.429625:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176834.429631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176834.429633:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176834.429638:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176834.429640:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145634432:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176834.429646:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00100000:2.0:1786176834.429652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145634560:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176834.429653:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176834.429661:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176834.429668:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786176834.429681:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176834.429685:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145634816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176834.429697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe67800 x1872931145634560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176834.429698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176834.429708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176834.429711:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176834.429717:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145634560/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176834.429724:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176834.429726:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10568
00000100:00080000:2.0:1786176834.429729:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176834.429734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145634560:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176834.429735:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176834.429742:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145634688:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176834.429749:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176834.429766:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145634944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176834.429768:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429777:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe66300 x1872931145634688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176834.429789:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145634688/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176834.429794:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176834.429797:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176834.429799:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145634688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176834.429803:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145634816:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176834.429816:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429822:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe64a80 x1872931145634816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176834.429829:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145634816/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176834.429839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176834.429842:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176834.429844:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145634816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176834.429852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145634944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176834.429865:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176834.429874:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176834/real 1786176834]  req@ffff89d99fe67800 x1872931145634944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176834.429885:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145634944/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176834.429917:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176834.429920:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176834.429922:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145634944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176834.940962:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176834.941086:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176835.452981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176835.964975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176835.965033:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176836.477014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176836.989056:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176836.989140:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176837.501023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176838.013017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176838.013098:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176838.525052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176839.037038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176839.037101:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176839.549000:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176839.549024:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176839.549028:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176839.549038:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00100000:3.0:1786176839.549038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176839.549048:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176839.549056:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176839.549096:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145635072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176839.549118:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176839.549121:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176839.549123:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176839.549126:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00080000:0.0:1786176839.549128:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176839.549130:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176839.549137:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176839.549146:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145635200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176839.549154:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176839.549156:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176839.549160:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176839.549161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145635072:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176839.549165:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00080000:0.0:1786176839.549171:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176839.549174:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176839.549178:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176839.549188:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145635328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176839.549194:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176839.549197:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176839.549198:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176839.549201:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00080000:0.0:1786176839.549204:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176839.549206:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176839.549209:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176839.549216:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145635456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176839.549223:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1786176839.549224:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176839.549226:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176839.549230:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176839.549233:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00080000:0.0:1786176839.549237:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176839.549239:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176839.549242:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176839.549250:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145635584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176839.549256:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176839.549259:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176839.549260:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176839.549262:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00080000:0.0:1786176839.549265:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176839.549268:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176839.549271:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176839.549276:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f2a00 x1872931145635072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176839.549282:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145635712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176839.549308:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176839.549311:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176839.549313:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176839.549316:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00080000:0.0:1786176839.549318:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176839.549322:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145635072/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176839.549323:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176839.549328:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176839.549339:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145635840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176839.549368:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176839.549371:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176839.549372:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176839.549373:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176839.549383:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00080000:2.0:1786176839.549385:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176839.549386:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176839.549392:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176839.549397:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176839.549397:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145635072:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176839.549407:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145635968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176839.549415:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176839.549417:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176839.549418:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176839.549420:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10573
00000100:00080000:0.0:1786176839.549423:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176839.549425:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176839.549429:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145635200:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176839.549431:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176839.549440:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145636096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786176839.549464:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176839.549492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f2680 x1872931145635200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176839.549507:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145635200/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176839.549516:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176839.549520:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176839.549524:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145635200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176839.549530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145635328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176839.549551:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176839.549562:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f1880 x1872931145635328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176839.549575:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145635328/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176839.549583:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176839.549587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176839.549590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145635328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176839.549597:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145635456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176839.549618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176839.549629:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f0700 x1872931145635456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176839.549642:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145635456/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176839.549649:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176839.549653:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176839.549656:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145635456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176839.549671:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145635584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176839.549692:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176839.549703:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f2d80 x1872931145635584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176839.549715:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145635584/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176839.549723:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176839.549726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176839.549730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145635584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176839.549736:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145635712:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176839.549767:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176839.549780:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f1180 x1872931145635712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176839.549792:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145635712/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176839.549800:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176839.549803:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176839.549807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145635712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176839.549813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145635840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176839.549832:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176839.549843:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f0a80 x1872931145635840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176839.549855:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145635840/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176839.549863:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176839.549867:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176839.549870:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145635840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176839.549876:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145635968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176839.549925:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176839.549937:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f3b80 x1872931145635968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176839.549949:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145635968/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176839.549964:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176839.549967:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176839.549971:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145635968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176839.549994:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145636096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176839.550029:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176839.550044:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176839/real 1786176839]  req@ffff89d9870f3480 x1872931145636096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176839.550057:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145636096/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176839.550066:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176839.550069:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176839.550073:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145636096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176840.060985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176840.061055:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176840.573028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176841.085035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176841.085109:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176841.597033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176842.109031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176842.109152:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176842.621042:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176843.133178:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176843.133289:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176843.645066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176844.157051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176844.157136:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176844.669063:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176844.669076:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176844.669081:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176844.669092:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669101:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669107:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176844.669150:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145636224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1786176844.669172:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176844.669185:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176844.669191:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176844.669194:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176844.669199:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669203:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669208:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176844.669217:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176844.669229:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145636352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176844.669240:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176844.669244:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176844.669246:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176844.669253:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145636224:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176844.669253:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669259:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669266:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176844.669271:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176844.669286:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145636480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176844.669294:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176844.669297:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176844.669299:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176844.669302:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669306:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669308:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176844.669312:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176844.669321:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145636608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176844.669330:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176844.669331:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176844.669334:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176844.669337:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176844.669340:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669343:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669345:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176844.669348:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176844.669355:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145636736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176844.669361:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176844.669364:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176844.669365:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176844.669368:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669370:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669372:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176844.669375:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176844.669382:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145636864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176844.669391:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176844.669393:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87ed80 x1872931145636224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176844.669396:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176844.669400:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176844.669411:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669417:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669422:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176844.669427:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145636224/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176844.669430:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786176844.669444:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176844.669449:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176844.669457:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145636992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176844.669458:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145636224:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176844.669472:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145636352:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176844.669476:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176844.669481:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176844.669483:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176844.669490:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669495:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669502:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786176844.669503:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176844.669512:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176844.669523:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87c700 x1872931145636352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176844.669526:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145637120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176844.669556:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176844.669559:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176844.669563:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176844.669564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145636352/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176844.669568:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10578
00000100:00080000:2.0:1786176844.669574:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176844.669581:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176844.669584:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176844.669585:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176844.669594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176844.669598:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145637248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176844.669603:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145636352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176844.669634:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145636480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176844.669658:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176844.669671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87c380 x1872931145636480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176844.669685:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145636480/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176844.669695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176844.669698:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176844.669702:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145636480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176844.669709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145636608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176844.669730:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176844.669742:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87ca80 x1872931145636608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176844.669755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145636608/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176844.669764:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176844.669767:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176844.669771:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145636608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176844.669777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145636736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176844.669797:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176844.669809:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87dc00 x1872931145636736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176844.669820:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145636736/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176844.669829:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176844.669833:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176844.669836:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145636736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176844.669842:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145636864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176844.669862:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176844.669874:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87e680 x1872931145636864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176844.669888:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145636864/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176844.669918:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176844.669922:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176844.669926:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145636864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176844.669932:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145636992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176844.669952:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176844.669982:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87d880 x1872931145636992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176844.669996:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145636992/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176844.670004:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176844.670008:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176844.670012:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145636992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176844.670019:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145637120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176844.670041:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176844.670054:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87f800 x1872931145637120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176844.670068:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145637120/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176844.670083:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176844.670087:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176844.670091:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145637120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176844.670097:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145637248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176844.670119:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176844.670132:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176844/real 1786176844]  req@ffff89d99e87df80 x1872931145637248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176844.670145:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145637248/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176844.670154:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176844.670157:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176844.670160:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145637248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176845.181037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176845.181102:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176845.692992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176846.204998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176846.205061:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176846.717012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176847.229034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176847.229116:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176847.741034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176848.253005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176848.253116:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176848.765059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176849.277041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176849.277109:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176849.789016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176849.789019:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789028:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176849.789031:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789040:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00080000:0.0:1786176849.789048:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789054:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176849.789087:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145637376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176849.789109:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789112:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176849.789113:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789116:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00080000:0.0:1786176849.789119:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789121:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176849.789129:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176849.789141:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145637504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176849.789141:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145637376:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176849.789155:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789157:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176849.789158:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789161:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00080000:0.0:1786176849.789163:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789166:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176849.789169:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176849.789178:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145637632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176849.789186:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789189:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176849.789190:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789193:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00080000:0.0:1786176849.789197:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789200:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176849.789204:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786176849.789208:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176849.789213:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145637760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176849.789221:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789224:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176849.789225:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789228:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00080000:0.0:1786176849.789230:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789232:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176849.789235:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176849.789241:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145637888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176849.789247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789249:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176849.789250:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789253:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00080000:0.0:1786176849.789255:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789257:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176849.789260:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176849.789264:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f1500 x1872931145637376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176849.789270:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145638016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176849.789292:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789295:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176849.789297:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789302:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00100000:2.0:1786176849.789302:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145637376/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176849.789307:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789314:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176849.789319:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1786176849.789320:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789325:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176849.789328:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145638144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176849.789333:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145637376:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176849.789344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789346:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176849.789348:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789352:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00080000:0.0:1786176849.789354:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789357:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176849.789360:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176849.789362:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145637504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176849.789369:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145638272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176849.789377:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176849.789379:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176849.789380:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176849.789383:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10584
00000100:00080000:0.0:1786176849.789388:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176849.789391:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176849.789394:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786176849.789397:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176849.789404:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145638400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176849.789417:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f0e00 x1872931145637504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176849.789434:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145637504/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176849.789445:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789448:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176849.789450:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145637504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176849.789455:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145637632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176849.789474:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176849.789482:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f3100 x1872931145637632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176849.789490:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145637632/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176849.789495:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789498:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176849.789500:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145637632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176849.789503:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145637760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176849.789513:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176849.789519:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f3480 x1872931145637760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176849.789526:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145637760/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176849.789531:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789533:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176849.789535:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145637760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176849.789538:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145637888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176849.789548:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176849.789553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f3b80 x1872931145637888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176849.789565:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145637888/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176849.789570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176849.789573:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145637888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176849.789576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145638016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176849.789585:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176849.789590:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f0a80 x1872931145638016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176849.789597:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145638016/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176849.789602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176849.789606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145638016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176849.789609:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145638144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786176849.789618:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176849.789623:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f1180 x1872931145638144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176849.789630:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145638144/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176849.789639:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176849.789643:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145638144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176849.789665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145638272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176849.789677:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176849.789683:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f2d80 x1872931145638272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176849.789691:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145638272/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176849.789700:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176849.789707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145638272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176849.789713:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145638400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786176849.789732:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176849.789742:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176849/real 1786176849]  req@ffff89d9870f0700 x1872931145638400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176849.789753:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145638400/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176849.789761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176849.789763:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176849.789767:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145638400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176850.300974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176850.301068:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176850.812978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176851.325034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176851.325114:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176851.837008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176852.348971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176852.349060:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176852.861002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176853.373020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176853.373083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176853.885008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176854.397004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176854.397106:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176854.909020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176854.909073:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176854.909084:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176854.909090:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176854.909105:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.909117:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176854.909126:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176854.909173:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145638528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176854.909210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176854.909215:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176854.909217:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176854.909222:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.909227:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176854.909232:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176854.909245:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176854.909261:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145638656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176854.909275:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145638528:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786176854.909283:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176854.909290:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176854.909293:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176854.909299:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.909304:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176854.909309:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176854.909319:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176854.909346:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145638784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176854.909369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176854.909375:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176854.909380:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176854.909388:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.909396:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176854.909406:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176854.909418:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176854.909436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145638656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176854.909452:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145638912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176854.909481:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176854.909489:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176854.909493:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176854.909501:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.909510:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786176854.909512:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145638784:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176854.909528:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176854.909543:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176854.909571:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145638912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176854.909581:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145639040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176854.909610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786176854.909617:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145639040:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786176854.909622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176854.909629:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176854.909639:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.909649:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176854.909658:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176854.909668:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176854.909690:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145639168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176854.909720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176854.909726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176854.909729:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176854.909736:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.909743:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176854.909749:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176854.909758:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176854.909760:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145639168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176854.909782:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145639296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176854.909801:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176854.909806:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176854.909809:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786176854.909814:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145639296:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176854.909822:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.909833:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176854.909841:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176854.909850:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176854.909973:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145639424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176854.910009:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176854.910015:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176854.910018:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176854.910026:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10589
00000100:00080000:1.0:1786176854.910036:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176854.910046:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176854.910059:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176854.910075:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145639424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176854.910091:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145639552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786176854.910157:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145639552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176855.420993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176855.421063:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176855.933048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176856.444979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176856.445031:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176856.956979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176857.469009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176857.469061:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176857.981061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786176857.981274:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786176857.981330:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786176857.981351:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176857.981425:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786176857.981442:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176857.981456:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176857.981468:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176857.981480:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786176857.981482:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2ff800 x1872931145639552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176857.981494:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176857.981526:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786176857.981535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145639552/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176857.981548:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:2.0:1786176857.981563:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145639552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176857.981597:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2fdf80 x1872931145639424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176857.981619:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145639424/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176857.981631:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981637:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981641:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145639424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176857.981652:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2fea00 x1872931145639296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176857.981669:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145639296/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176857.981678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981683:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981686:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145639296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176857.981695:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2fed80 x1872931145639168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176857.981708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145639168/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176857.981717:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981722:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981726:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145639168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176857.981734:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2fd180 x1872931145639040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176857.981749:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145639040/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176857.981759:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981764:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981767:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145639040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176857.981776:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2ff100 x1872931145638912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176857.981793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145638912/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176857.981801:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981806:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981810:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145638912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786176857.981818:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2fc380 x1872931145638656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176857.981849:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145638656/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176857.981858:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981867:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145638656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176857.981876:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2ffb80 x1872931145638784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176857.981893:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145638784/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176857.981934:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981939:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981943:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145638784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176857.981954:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176854/real 1786176857]  req@ffff89d9ba2fd500 x1872931145638528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176857.981980:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145638528/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176857.981990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176857.981994:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176857.981999:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145638528:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176858.493076:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176858.493173:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176859.005085:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176859.517043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176859.517118:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176860.029060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176860.029186:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029193:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176860.029197:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176860.029208:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029219:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176860.029226:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176860.029280:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145639680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176860.029322:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029329:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176860.029332:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176860.029337:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029342:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176860.029348:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176860.029362:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176860.029381:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145639680:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176860.029381:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145639808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176860.029392:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029396:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176860.029397:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176860.029402:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029407:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176860.029411:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176860.029417:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176860.029433:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145639936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176860.029444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029448:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176860.029449:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176860.029452:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029455:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176860.029458:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176860.029465:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176860.029478:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145640064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176860.029487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029491:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176860.029493:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176860.029498:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029500:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176860.029506:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176860.029514:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176860.029516:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176860.029537:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145640192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176860.029545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176860.029551:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176860.029556:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029560:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176860.029564:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176860.029571:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176860.029585:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145640320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176860.029596:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029600:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176860.029604:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176860.029610:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029615:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176860.029621:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176860.029633:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176860.029647:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145640448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176860.029657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029661:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176860.029663:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176860.029671:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029675:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176860.029678:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87d500 x1872931145639680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176860.029681:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176860.029687:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176860.029701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145640576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176860.029708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145639680/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176860.029711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176860.029716:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176860.029718:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176860.029723:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176860.029723:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10594
00000100:00080000:2.0:1786176860.029726:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176860.029729:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176860.029730:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176860.029734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145639680:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176860.029736:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176860.029749:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145640704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176860.029777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145639808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176860.029828:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176860.029845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87c000 x1872931145639808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176860.029859:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145639808/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176860.029869:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176860.029873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176860.029877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145639808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176860.029884:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145639936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176860.029940:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176860.029956:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87f100 x1872931145639936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176860.029990:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145639936/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176860.030007:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176860.030012:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176860.030016:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145639936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176860.030024:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145640064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176860.030053:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176860.030068:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87df80 x1872931145640064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176860.030083:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145640064/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176860.030092:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176860.030096:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176860.030100:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145640064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176860.030106:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145640192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176860.030127:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176860.030137:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87f800 x1872931145640192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176860.030149:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145640192/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176860.030157:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176860.030160:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176860.030165:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145640192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176860.030171:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145640320:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176860.030196:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176860.030208:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87d880 x1872931145640320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176860.030226:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145640320/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176860.030239:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176860.030242:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176860.030246:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145640320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176860.030252:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145640448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176860.030271:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176860.030285:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87e680 x1872931145640448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176860.030296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145640448/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176860.030304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176860.030308:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176860.030311:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145640448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176860.030317:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145640576:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176860.030333:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176860.030342:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87dc00 x1872931145640576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176860.030353:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145640576/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176860.030362:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176860.030364:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176860.030367:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145640576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176860.030372:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145640704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176860.030387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176860.030396:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176860/real 1786176860]  req@ffff89d99e87ca80 x1872931145640704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176860.030407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145640704/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176860.030415:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176860.030419:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176860.030421:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145640704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176860.541095:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176860.541178:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176861.052978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176861.564991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176861.565080:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176862.077029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176862.589022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176862.589121:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176863.100970:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176863.612966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176863.613030:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176864.125012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176864.637024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176864.637088:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176865.149005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176865.149009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176865.149016:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176865.149021:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176865.149033:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00080000:2.0:1786176865.149044:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176865.149051:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176865.149099:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145640832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176865.149124:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176865.149127:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176865.149128:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176865.149131:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00080000:2.0:1786176865.149135:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176865.149139:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176865.149147:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176865.149156:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145640832:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176865.149160:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145640960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176865.149170:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176865.149172:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176865.149174:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176865.149177:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00080000:2.0:1786176865.149179:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176865.149182:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176865.149186:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176865.149194:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145641088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176865.149200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176865.149203:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176865.149204:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176865.149206:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00080000:2.0:1786176865.149208:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176865.149211:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176865.149213:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176865.149221:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176865.149224:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145641216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176865.149231:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176865.149234:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176865.149235:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176865.149239:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00080000:2.0:1786176865.149241:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176865.149243:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176865.149246:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176865.149253:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145641344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176865.149262:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87c380 x1872931145640832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176865.149264:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176865.149275:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176865.149280:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176865.149288:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00100000:0.0:1786176865.149289:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145640832/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176865.149295:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176865.149305:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176865.149307:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176865.149311:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176865.149316:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145640832:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786176865.149318:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176865.149331:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145641472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176865.149337:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145640960:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176865.149346:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176865.149350:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176865.149352:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176865.149356:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00080000:2.0:1786176865.149360:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176865.149362:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176865.149366:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176865.149370:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176865.149378:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145641600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176865.149384:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87c700 x1872931145640960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176865.149386:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176865.149392:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176865.149395:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176865.149403:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00100000:0.0:1786176865.149407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145640960/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176865.149410:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176865.149420:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176865.149421:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786176865.149425:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786176865.149431:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176865.149435:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145640960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176865.149443:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145641088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176865.149451:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145641728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176865.149460:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176865.149469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176865.149473:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87ed80 x1872931145641088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176865.149477:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176865.149483:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176865.149489:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145641088/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176865.149492:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10599
00000100:00080000:2.0:1786176865.149498:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176865.149505:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176865.149509:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786176865.149519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176865.149523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176865.149526:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145641856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176865.149529:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145641088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176865.149542:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145641216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176865.149560:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176865.149569:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87ca80 x1872931145641216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176865.149576:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145641216/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176865.149581:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176865.149583:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176865.149585:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145641216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176865.149589:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145641344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176865.149598:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176865.149604:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87dc00 x1872931145641344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176865.149611:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145641344/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176865.149616:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176865.149618:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176865.149620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145641344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176865.149631:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145641472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176865.149641:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176865.149647:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87e680 x1872931145641472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176865.149654:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145641472/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176865.149659:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176865.149661:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176865.149663:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145641472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176865.149668:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145641600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176865.149685:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176865.149697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87d880 x1872931145641600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176865.149710:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145641600/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176865.149718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176865.149735:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176865.149739:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145641600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176865.149745:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145641728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176865.149775:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176865.149785:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87f800 x1872931145641728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176865.149793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145641728/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176865.149799:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176865.149801:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176865.149803:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145641728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176865.149807:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145641856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176865.149818:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176865.149824:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176865/real 1786176865]  req@ffff89d99e87df80 x1872931145641856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176865.149833:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145641856/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176865.149842:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176865.149844:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176865.149848:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145641856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176865.660989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176865.661041:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176866.173009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176866.685009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176866.685089:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176867.197008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176867.708984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176867.709070:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176868.220975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176868.733012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176868.733078:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176869.244995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176869.756996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176869.757064:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176870.268992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176870.268992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176870.269003:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176870.269008:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176870.269016:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00080000:2.0:1786176870.269025:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176870.269032:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176870.269064:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145641984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176870.269088:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176870.269091:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176870.269093:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176870.269096:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00080000:2.0:1786176870.269099:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176870.269102:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176870.269111:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176870.269118:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145641984:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176870.269125:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145642112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176870.269135:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176870.269144:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176870.269146:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176870.269152:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00080000:2.0:1786176870.269156:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176870.269159:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176870.269163:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176870.269173:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145642240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176870.269181:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176870.269187:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176870.269190:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176870.269192:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176870.269197:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00080000:2.0:1786176870.269200:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176870.269203:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176870.269208:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176870.269219:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145642368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176870.269224:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87f100 x1872931145641984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176870.269259:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176870.269261:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176870.269263:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176870.269265:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145641984/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176870.269269:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00080000:2.0:1786176870.269275:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176870.269281:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176870.269283:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176870.269285:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176870.269289:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176870.269294:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145641984:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176870.269297:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145642496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176870.269305:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176870.269307:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176870.269308:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176870.269311:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00080000:2.0:1786176870.269313:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176870.269317:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145642112:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176870.269320:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176870.269328:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176870.269338:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145642624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176870.269345:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176870.269345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176870.269351:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176870.269353:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176870.269357:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00100000:1.0:1786176870.269362:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87c000 x1872931145642112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176870.269363:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176870.269371:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176870.269380:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176870.269383:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145642112/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176870.269390:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145642752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176870.269394:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176870.269403:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176870.269404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176870.269408:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145642112:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176870.269412:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176870.269416:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176870.269419:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145642240:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176870.269425:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00080000:2.0:1786176870.269431:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176870.269436:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176870.269442:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176870.269450:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176870.269456:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145642880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176870.269468:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87d500 x1872931145642240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176870.269469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176870.269478:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176870.269483:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176870.269493:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10604
00000100:00100000:1.0:1786176870.269498:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145642240/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176870.269499:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176870.269510:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176870.269515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176870.269518:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176870.269523:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176870.269534:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145643008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176870.269544:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145642240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176870.269562:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145642368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176870.269588:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176870.269604:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87df80 x1872931145642368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176870.269627:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145642368/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176870.269634:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176870.269636:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176870.269638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145642368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176870.269643:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145642496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176870.269663:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176870.269671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87f800 x1872931145642496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176870.269679:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145642496/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176870.269684:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176870.269685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176870.269687:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145642496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176870.269699:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145642624:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176870.269727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176870.269740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87d880 x1872931145642624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176870.269753:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145642624/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176870.269768:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176870.269771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176870.269774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145642624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176870.269781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145642752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176870.269798:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176870.269806:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87e680 x1872931145642752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176870.269814:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145642752/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176870.269819:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176870.269821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176870.269823:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145642752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176870.269826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145642880:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176870.269840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176870.269849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87dc00 x1872931145642880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176870.269860:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145642880/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176870.269870:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176870.269873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176870.269877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145642880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176870.269883:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145643008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176870.269925:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176870.269938:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176870/real 1786176870]  req@ffff89d99e87ca80 x1872931145643008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176870.269948:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145643008/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176870.269955:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176870.269958:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176870.269960:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145643008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176870.781008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176870.781079:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176871.293006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176871.804970:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176871.805050:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176872.317013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176872.828998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176872.829053:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176873.340979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176873.852975:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176873.853086:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176874.364978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176874.877027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176874.877109:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176875.389004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176875.389008:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176875.389015:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176875.389019:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176875.389026:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:2.0:1786176875.389035:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176875.389041:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176875.389078:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145643136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176875.389101:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176875.389104:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176875.389106:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176875.389112:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:2.0:1786176875.389119:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176875.389123:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176875.389130:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176875.389143:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145643264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176875.389152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176875.389154:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176875.389157:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176875.389159:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145643136:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176875.389162:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:2.0:1786176875.389168:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176875.389171:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176875.389175:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176875.389185:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145643392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176875.389191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176875.389194:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176875.389195:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176875.389199:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:2.0:1786176875.389201:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176875.389203:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176875.389207:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176875.389215:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145643520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176875.389222:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176875.389228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176875.389232:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176875.389233:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176875.389237:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:2.0:1786176875.389241:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176875.389243:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176875.389246:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176875.389254:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145643648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176875.389261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176875.389264:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87ed80 x1872931145643136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176875.389265:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176875.389268:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176875.389276:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:2.0:1786176875.389281:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176875.389286:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176875.389290:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176875.389292:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145643136/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176875.389300:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145643776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176875.389302:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176875.389310:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176875.389315:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176875.389318:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145643136:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176875.389322:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176875.389327:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176875.389333:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:2.0:1786176875.389337:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176875.389342:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145643264:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176875.389344:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176875.389352:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786176875.389363:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176875.389370:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145643904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176875.389376:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87c700 x1872931145643264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176875.389391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176875.389396:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145643264/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176875.389397:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176875.389401:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176875.389409:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:0.0:1786176875.389412:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176875.389414:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176875.389418:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176875.389421:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176875.389425:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145643264:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786176875.389429:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176875.389432:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145643392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786176875.389445:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145644032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176875.389453:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176875.389457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176875.389460:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176875.389462:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176875.389465:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87c380 x1872931145643392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176875.389469:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10609
00000100:00080000:2.0:1786176875.389473:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176875.389480:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176875.389485:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176875.389488:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145643392/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176875.389496:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786176875.389496:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145644160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176875.389504:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176875.389512:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145643392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176875.389519:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145643520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176875.389534:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176875.389540:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87ca80 x1872931145643520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176875.389547:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145643520/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176875.389554:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176875.389557:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176875.389559:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145643520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176875.389566:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145643648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176875.389585:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176875.389596:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87dc00 x1872931145643648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176875.389609:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145643648/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176875.389623:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176875.389627:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176875.389630:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145643648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176875.389637:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145643776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176875.389657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176875.389686:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87e680 x1872931145643776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176875.389701:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145643776/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176875.389709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176875.389713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176875.389716:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145643776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176875.389737:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145643904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176875.389759:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176875.389773:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87d880 x1872931145643904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176875.389786:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145643904/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176875.389795:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176875.389798:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176875.389803:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145643904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176875.389810:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145644032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176875.389829:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176875.389841:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87f800 x1872931145644032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176875.389854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145644032/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176875.389863:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176875.389866:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176875.389869:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145644032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176875.389876:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145644160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176875.389920:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176875.389935:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176875/real 1786176875]  req@ffff89d99e87df80 x1872931145644160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176875.389949:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145644160/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176875.389958:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176875.389961:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176875.389964:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145644160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176875.900996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176875.901074:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176876.413017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176876.925017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176876.925065:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176877.437006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176877.949006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176877.949083:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176878.460996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176878.972982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176878.973060:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176879.485181:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176879.997029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176879.997123:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176880.508967:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786176880.509036:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176880.509045:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786176880.509050:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176880.509060:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10614
00000100:00080000:1.0:1786176880.509072:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176880.509079:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176880.509123:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145644288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176880.509149:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176880.509152:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176880.509153:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176880.509157:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10614
00000100:00080000:1.0:1786176880.509160:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176880.509163:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176880.509178:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176880.509189:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145644288:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176880.509191:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145644416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176880.509208:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176880.509211:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176880.509213:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176880.509218:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10614
00000100:00080000:1.0:1786176880.509221:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176880.509224:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176880.509228:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176880.509240:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145644544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176880.509248:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176880.509252:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176880.509254:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176880.509257:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10614
00000100:00080000:1.0:1786176880.509259:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176880.509268:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176880.509272:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176880.509278:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176880.509290:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145644672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176880.509299:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176880.509306:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176880.509309:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176880.509313:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2fc700 x1872931145644288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176880.509314:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10614
00000100:00080000:1.0:1786176880.509324:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176880.509338:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176880.509346:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176880.509352:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145644288/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176880.509359:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145644800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176880.509370:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176880.509376:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176880.509377:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176880.509381:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176880.509381:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10614
00000100:00080000:1.0:1786176880.509384:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176880.509390:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176880.509394:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176880.509403:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176880.509404:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145644288:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176880.509431:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145644928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176880.509447:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176880.509448:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145644416:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176880.509462:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176880.509466:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176880.509475:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10614
00000800:00000100:0.0:1786176880.509484:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176880.509488:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176880.509497:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176880.509498:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2ff480 x1872931145644416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1786176880.509507:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176880.509515:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145644416/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176880.509524:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145645056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176880.509525:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176880.509545:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786176880.509546:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176880.509559:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786176880.509561:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176880.509564:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145644416:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786176880.509568:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10614
00000100:00080000:1.0:1786176880.509576:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176880.509581:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176880.509585:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145644544:192.168.202.130@tcp:38:kworker.0
00000008:00100000:1.0:1786176880.509586:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176880.509629:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145645184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176880.509639:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176880.509642:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786176880.509644:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176880.509647:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10614
00000800:00000100:0.0:1786176880.509653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786176880.509654:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176880.509665:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786176880.509671:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176880.509677:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2fdc00 x1872931145644544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176880.509687:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145645312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176880.509693:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145644544/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176880.509703:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176880.509707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176880.509721:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145644544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176880.509740:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145644672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176880.509764:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176880.509775:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2fe300 x1872931145644672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176880.509784:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145644672/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176880.509790:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176880.509792:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176880.509795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145644672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176880.509799:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145644800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176880.509810:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176880.509815:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2fe680 x1872931145644800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176880.509822:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145644800/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176880.509828:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176880.509830:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176880.509832:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145644800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176880.509846:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145644928:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176880.509857:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176880.509863:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2fd880 x1872931145644928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176880.509870:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145644928/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176880.509875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176880.509877:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176880.509879:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145644928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176880.509883:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145645056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176880.509893:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176880.509920:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2fce00 x1872931145645056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176880.509929:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145645056/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176880.509934:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176880.509936:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176880.509939:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145645056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176880.509943:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145645184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176880.509955:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176880.509961:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2fc700 x1872931145645184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176880.509968:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145645184/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176880.509974:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176880.509975:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176880.509977:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145645184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176880.509981:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145645312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176880.509991:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176880.509997:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176880/real 1786176880]  req@ffff89d9ba2fd500 x1872931145645312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176880.510004:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145645312/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176880.510009:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176880.510011:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176880.510013:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145645312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176881.021008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176881.021070:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176881.533021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176882.044998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176882.045054:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176882.556965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176883.068993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176883.069056:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176883.580958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176884.093005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176884.093103:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176884.604994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176885.117048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176885.117125:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176885.629053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176885.629133:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629141:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176885.629146:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176885.629159:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00080000:0.0:1786176885.629173:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176885.629184:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176885.629230:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145645440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176885.629257:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629261:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176885.629262:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176885.629265:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00080000:0.0:1786176885.629268:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176885.629272:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176885.629282:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176885.629294:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145645568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176885.629308:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145645440:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176885.629309:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629322:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176885.629325:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176885.629330:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00080000:0.0:1786176885.629332:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176885.629338:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176885.629340:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176885.629351:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145645696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176885.629358:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629361:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176885.629363:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176885.629366:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00080000:0.0:1786176885.629385:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176885.629388:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176885.629391:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176885.629398:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176885.629403:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145645824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176885.629413:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629418:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176885.629420:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176885.629425:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00080000:0.0:1786176885.629429:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176885.629432:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176885.629436:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176885.629445:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145645952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176885.629453:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629458:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176885.629461:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176885.629463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f1880 x1872931145645440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176885.629468:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00080000:0.0:1786176885.629474:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176885.629486:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176885.629498:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176885.629517:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145646080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176885.629524:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145645440/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176885.629558:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629576:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786176885.629577:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176885.629583:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176885.629587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176885.629597:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00100000:1.0:1786176885.629598:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145645440:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176885.629609:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176885.629615:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176885.629621:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176885.629632:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145645568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176885.629634:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145646208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176885.629653:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629657:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176885.629659:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176885.629665:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00080000:0.0:1786176885.629669:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176885.629672:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176885.629683:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786176885.629684:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176885.629698:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145646336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176885.629707:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176885.629712:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176885.629713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f2680 x1872931145645568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176885.629718:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176885.629736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145645568/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176885.629744:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10619
00000100:00080000:1.0:1786176885.629749:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176885.629754:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176885.629755:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176885.629764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145645568:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176885.629770:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176885.629777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145645696:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176885.629782:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176885.629804:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176885.629810:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145646464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176885.629819:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f2a00 x1872931145645696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176885.629840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145645696/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176885.629852:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176885.629857:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176885.629861:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145645696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176885.629866:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145645824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176885.629883:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176885.629890:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f0700 x1872931145645824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176885.629924:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145645824/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176885.629929:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176885.629932:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176885.629934:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145645824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176885.629938:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145645952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176885.629951:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176885.629959:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f2d80 x1872931145645952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176885.629966:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145645952/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176885.629971:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176885.629974:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176885.629976:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145645952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176885.629979:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145646080:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176885.629990:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176885.629997:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f1180 x1872931145646080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176885.630009:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145646080/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176885.630017:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176885.630021:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176885.630024:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145646080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176885.630045:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145646208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176885.630061:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176885.630070:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f0a80 x1872931145646208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176885.630077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145646208/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176885.630083:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176885.630085:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176885.630087:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145646208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176885.630091:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145646336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176885.630102:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176885.630107:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f3b80 x1872931145646336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176885.630114:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145646336/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176885.630120:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176885.630122:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176885.630123:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145646336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176885.630127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145646464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176885.630136:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176885.630142:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176885/real 1786176885]  req@ffff89d9870f3480 x1872931145646464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176885.630149:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145646464/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176885.630154:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176885.630156:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176885.630158:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145646464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176886.141025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176886.141129:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176886.652963:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176887.164978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176887.165047:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176887.676977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176888.189030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176888.189125:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176888.700958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176889.212958:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176889.213070:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176889.724979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176890.237043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176890.237117:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176890.749047:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176890.749053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176890.749059:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176890.749066:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176890.749076:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00080000:2.0:1786176890.749087:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749093:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176890.749134:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145646592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176890.749159:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176890.749162:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176890.749164:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176890.749166:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00080000:2.0:1786176890.749169:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749173:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176890.749182:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176890.749191:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145646720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176890.749199:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176890.749201:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176890.749203:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176890.749208:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145646592:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176890.749208:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00080000:2.0:1786176890.749212:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749218:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176890.749223:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176890.749231:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145646848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176890.749237:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176890.749240:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176890.749241:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176890.749243:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00080000:2.0:1786176890.749245:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749248:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176890.749251:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176890.749258:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145646976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176890.749263:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176890.749267:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176890.749268:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176890.749270:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00080000:2.0:1786176890.749273:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749275:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176890.749278:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176890.749283:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176890.749289:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145647104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176890.749295:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176890.749298:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176890.749299:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176890.749302:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00080000:2.0:1786176890.749304:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749307:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176890.749310:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176890.749318:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145647232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176890.749324:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176890.749326:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176890.749327:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176890.749332:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00100000:1.0:1786176890.749335:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87d500 x1872931145646592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176890.749335:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749341:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176890.749348:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176890.749358:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145647360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176890.749365:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176890.749369:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145646592/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176890.749369:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176890.749374:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176890.749381:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00080000:2.0:1786176890.749387:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749392:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176890.749395:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176890.749396:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176890.749406:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786176890.749408:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145647488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176890.749415:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145646592:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176890.749419:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176890.749426:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176890.749427:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176890.749431:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10624
00000100:00080000:2.0:1786176890.749433:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176890.749436:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176890.749439:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176890.749445:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145647616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176890.749452:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145646720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176890.749480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176890.749494:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87c000 x1872931145646720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176890.749508:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145646720/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176890.749533:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176890.749537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176890.749541:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145646720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176890.749548:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145646848:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176890.749570:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176890.749584:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87f100 x1872931145646848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176890.749597:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145646848/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176890.749613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176890.749617:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176890.749621:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145646848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176890.749627:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145646976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176890.749648:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176890.749660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87df80 x1872931145646976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176890.749673:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145646976/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176890.749681:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176890.749685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176890.749688:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145646976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176890.749695:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145647104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176890.749714:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176890.749725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87f800 x1872931145647104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176890.749736:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145647104/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176890.749744:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176890.749747:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176890.749751:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145647104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176890.749757:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145647232:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176890.749777:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176890.749790:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87d880 x1872931145647232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176890.749803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145647232/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176890.749811:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176890.749814:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176890.749817:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145647232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176890.749823:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145647360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176890.749858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176890.749872:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87e680 x1872931145647360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176890.749884:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145647360/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176890.749893:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176890.749923:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176890.749927:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145647360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176890.749935:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145647488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176890.749956:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176890.749970:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87dc00 x1872931145647488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176890.749982:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145647488/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176890.749991:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176890.749994:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176890.749998:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145647488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176890.750020:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145647616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176890.750039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176890.750052:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176890/real 1786176890]  req@ffff89d99e87ca80 x1872931145647616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176890.750064:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145647616/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176890.750074:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176890.750078:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176890.750081:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145647616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176891.261022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176891.261097:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176891.772982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176892.285005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176892.285090:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176892.797013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176893.308962:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176893.309049:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176893.821017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176894.333001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176894.333062:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176894.845033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176895.357047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176895.357120:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176895.869044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176895.869048:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176895.869061:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176895.869067:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176895.869080:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10630
00000100:00080000:2.0:1786176895.869091:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869099:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176895.869140:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145647744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176895.869174:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176895.869178:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176895.869181:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176895.869187:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10630
00000100:00080000:2.0:1786176895.869191:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869197:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176895.869208:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176895.869214:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145647744:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176895.869230:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145647872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176895.869246:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176895.869249:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176895.869252:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176895.869258:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10630
00000100:00080000:2.0:1786176895.869264:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869268:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176895.869275:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176895.869288:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145648000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176895.869306:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176895.869311:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176895.869317:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176895.869320:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176895.869327:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10630
00000100:00080000:2.0:1786176895.869334:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869339:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176895.869346:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176895.869369:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87c380 x1872931145647744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176895.869370:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145648128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176895.869404:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176895.869406:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145647744/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176895.869409:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176895.869417:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176895.869431:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176895.869435:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10630
00000100:00080000:1.0:1786176895.869439:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176895.869448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145647744:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176895.869448:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869476:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176895.869484:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176895.869500:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145648256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176895.869509:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145647872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176895.869532:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176895.869538:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176895.869541:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176895.869549:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10630
00000800:00000100:1.0:1786176895.869559:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176895.869560:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869570:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176895.869577:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176895.869581:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87c700 x1872931145647872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176895.869597:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145647872/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176895.869600:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145648384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176895.869616:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176895.869629:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176895.869640:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145647872:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176895.869644:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176895.869650:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176895.869655:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145648000:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176895.869656:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176895.869667:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10630
00000100:00080000:2.0:1786176895.869674:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869679:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176895.869684:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176895.869696:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176895.869702:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145648512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176895.869713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87ed80 x1872931145648000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176895.869724:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176895.869733:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786176895.869734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145648000/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176895.869742:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176895.869746:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176895.869747:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176895.869757:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145648000:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176895.869766:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10630
00000100:00100000:1.0:1786176895.869773:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145648128:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176895.869776:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869786:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176895.869794:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176895.869800:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176895.869811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87ca80 x1872931145648128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176895.869819:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145648640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176895.869825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145648128/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176895.869875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176895.869890:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176895.869892:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176895.869925:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145648128:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176895.869937:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176895.869941:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176895.869947:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145648256:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786176895.869950:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10630
00000100:00080000:2.0:1786176895.869960:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176895.869968:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176895.869976:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176895.869978:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176895.869991:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87dc00 x1872931145648256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176895.870002:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145648768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176895.870003:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145648256/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176895.870072:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176895.870079:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176895.870086:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145648256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176895.870094:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145648384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176895.870116:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176895.870125:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87e680 x1872931145648384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176895.870134:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145648384/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176895.870140:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176895.870142:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176895.870145:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145648384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176895.870149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145648512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176895.870160:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176895.870166:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87d880 x1872931145648512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176895.870174:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145648512/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176895.870180:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176895.870181:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176895.870183:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145648512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176895.870187:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145648640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176895.870198:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176895.870204:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87f800 x1872931145648640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176895.870211:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145648640/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176895.870222:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176895.870224:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176895.870226:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145648640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176895.870238:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145648768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176895.870248:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176895.870254:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176895/real 1786176895]  req@ffff89d99e87df80 x1872931145648768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176895.870262:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145648768/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176895.870268:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176895.870270:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176895.870271:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145648768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176896.380997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176896.381123:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176896.893028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176897.404960:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176897.405041:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176897.916992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176898.429023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176898.429095:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176898.941016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176899.453034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176899.453129:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176899.964994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176900.477013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176900.477087:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176900.989010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176900.989028:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176900.989037:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176900.989042:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176900.989055:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989066:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989074:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176900.989118:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145648896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176900.989148:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176900.989151:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176900.989153:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176900.989156:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989158:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989161:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176900.989172:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176900.989180:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145649024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176900.989189:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176900.989192:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176900.989194:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176900.989202:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145648896:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176900.989202:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989205:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989214:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176900.989220:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176900.989229:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145649152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176900.989238:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176900.989242:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176900.989244:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176900.989248:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989252:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989256:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176900.989263:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176900.989281:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145649280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176900.989292:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176900.989295:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176900.989297:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176900.989305:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176900.989306:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989315:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989320:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176900.989325:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176900.989338:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145649408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176900.989345:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176900.989348:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176900.989350:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176900.989353:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989357:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989362:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176900.989366:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176900.989368:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87f100 x1872931145648896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176900.989378:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145649536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176900.989442:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176900.989443:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145648896/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176900.989454:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176900.989457:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176900.989465:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989473:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989483:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176900.989490:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1786176900.989494:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176900.989501:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.989509:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145648896:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176900.989511:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145649664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176900.989529:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176900.989531:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176900.989532:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176900.989536:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989538:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989542:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176900.989544:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176900.989557:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145649792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176900.989559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145649024:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176900.989585:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176900.989588:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176900.989589:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176900.989594:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10635
00000100:00080000:2.0:1786176900.989598:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176900.989601:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176900.989605:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176900.989613:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176900.989615:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145649920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176900.989639:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87c000 x1872931145649024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176900.989657:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145649024/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176900.989667:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176900.989670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.989674:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145649024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176900.989682:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145649152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176900.989705:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176900.989717:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87d500 x1872931145649152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176900.989730:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145649152/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176900.989739:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176900.989742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.989746:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145649152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176900.989753:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145649280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176900.989772:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176900.989785:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87df80 x1872931145649280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176900.989798:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145649280/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176900.989806:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176900.989809:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.989813:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145649280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176900.989820:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145649408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176900.989838:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176900.989849:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87f800 x1872931145649408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176900.989861:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145649408/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176900.989870:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176900.989874:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.989877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145649408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176900.989884:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145649536:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176900.989927:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176900.989940:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87d880 x1872931145649536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176900.989953:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145649536/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176900.989963:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176900.989966:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.989971:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145649536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176900.989978:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145649664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176900.989997:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176900.990007:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87e680 x1872931145649664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176900.990019:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145649664/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176900.990027:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176900.990030:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.990034:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145649664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176900.990056:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145649792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176900.990075:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176900.990086:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87dc00 x1872931145649792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176900.990098:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145649792/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176900.990107:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176900.990111:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.990115:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145649792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176900.990122:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145649920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176900.990141:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176900.990152:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176900/real 1786176900]  req@ffff89d99e87ca80 x1872931145649920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176900.990164:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145649920/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176925 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176900.990173:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176900.990176:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176900.990180:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145649920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176901.501019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176901.501108:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176902.012958:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176902.524989:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176902.525070:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176903.037001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176903.549022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176903.549101:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176904.061010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176904.572966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786176904.572998:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176905.085007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176905.596998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176905.597077:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176906.109036:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176906.109048:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1786176906.109052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176906.109053:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176906.109067:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109077:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176906.109086:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176906.109123:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145650048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176906.109153:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176906.109158:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176906.109160:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176906.109167:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109172:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176906.109177:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176906.109188:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176906.109203:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145650048:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176906.109206:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145650176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176906.109222:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176906.109226:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176906.109228:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176906.109233:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109237:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176906.109242:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176906.109247:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176906.109259:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145650304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176906.109271:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176906.109274:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176906.109278:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176906.109282:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176906.109288:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109293:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176906.109297:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176906.109304:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176906.109322:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe67480 x1872931145650048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176906.109344:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145650048/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176906.109355:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176906.109360:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176906.109381:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145650048:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176906.109401:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145650432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176906.109410:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145650176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176906.109420:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176906.109425:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176906.109428:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176906.109433:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109439:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176906.109444:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176906.109449:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176906.109467:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe66680 x1872931145650176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176906.109482:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145650176/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176906.109492:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176906.109495:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176906.109499:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145650176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176906.109506:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145650304:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176906.109531:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176906.109548:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe65880 x1872931145650304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176906.109564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145650304/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176906.109574:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176906.109579:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176906.109585:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176906.109591:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145650304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176906.109596:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145650560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176906.109616:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145650432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176906.109647:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176906.109662:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176906.109669:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe65180 x1872931145650432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176906.109669:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176906.109674:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176906.109684:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109692:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176906.109700:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176906.109707:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176906.109708:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145650432/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176906.109722:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176906.109728:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145650688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176906.109730:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176906.109740:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145650432:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176906.109752:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176906.109757:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176906.109759:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176906.109765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145650560:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176906.109768:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109775:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176906.109780:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176906.109787:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786176906.109799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176906.109804:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145650816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176906.109816:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe67100 x1872931145650560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176906.109820:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176906.109829:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176906.109834:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176906.109841:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109846:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176906.109852:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145650560/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176906.109853:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176906.109863:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176906.109868:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176906.109875:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176906.109880:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145650944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176906.109882:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145650560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176906.109924:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145650688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176906.109941:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176906.109946:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176906.109949:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176906.109955:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176906.109959:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10640
00000100:00080000:3.0:1786176906.109966:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176906.109972:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176906.109979:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176906.109981:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe64000 x1872931145650688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176906.109998:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145651072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176906.110001:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145650688/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176906.110054:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176906.110060:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176906.110065:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145650688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176906.110083:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145650816:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176906.110106:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176906.110119:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe65f80 x1872931145650816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176906.110131:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145650816/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176906.110141:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176906.110144:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176906.110148:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145650816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176906.110155:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145650944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176906.110175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176906.110187:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe66d80 x1872931145650944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176906.110199:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145650944/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176906.110208:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176906.110211:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176906.110215:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145650944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176906.110222:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145651072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176906.110240:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176906.110251:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176906/real 1786176906]  req@ffff89d99fe67b80 x1872931145651072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176906.110264:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145651072/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176906.110272:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176906.110275:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176906.110279:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145651072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176906.621032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176906.621103:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176907.133026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176907.645088:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176907.645176:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176908.156998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176908.668979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176908.669139:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176909.180989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176909.692984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176909.693059:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176910.205018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176910.716972:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176910.717050:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176911.228971:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.228983:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1786176911.228985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176911.228987:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176911.228998:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10645
00000100:00080000:3.0:1786176911.229009:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229016:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176911.229048:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145651200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176911.229077:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.229080:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176911.229081:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176911.229084:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10645
00000100:00080000:3.0:1786176911.229086:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229089:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176911.229096:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176911.229106:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145651328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176911.229113:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.229116:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176911.229118:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176911.229123:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10645
00000100:00100000:1.0:1786176911.229127:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145651200:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176911.229127:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229132:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176911.229139:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176911.229147:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145651456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176911.229154:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.229156:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176911.229158:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176911.229160:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10645
00000100:00080000:3.0:1786176911.229162:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229165:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176911.229169:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176911.229177:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145651584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176911.229184:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.229186:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176911.229188:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176911.229191:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10645
00000800:00000100:1.0:1786176911.229196:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176911.229196:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229203:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176911.229207:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176911.229215:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145651712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176911.229221:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.229224:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176911.229225:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176911.229228:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10645
00000100:00080000:3.0:1786176911.229231:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229234:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176911.229238:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176911.229243:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe65500 x1872931145651200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176911.229248:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145651840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176911.229270:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.229273:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176911.229275:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176911.229279:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145651200/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176911.229280:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10645
00000100:00080000:3.0:1786176911.229285:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229291:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176911.229298:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176911.229300:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176911.229306:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145651968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176911.229307:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229329:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145651200:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176911.229333:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.229337:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786176911.229340:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145651328:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176911.229340:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176911.229349:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10645
00000100:00080000:3.0:1786176911.229355:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229358:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176911.229362:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176911.229372:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145652096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176911.229379:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176911.229382:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1786176911.229385:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176911.229386:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176911.229393:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10645
00000100:00080000:3.0:1786176911.229396:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176911.229405:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176911.229409:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe66a00 x1872931145651328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176911.229410:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176911.229423:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145652224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176911.229432:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145651328/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176911.229442:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176911.229447:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229451:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145651328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176911.229475:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145651456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176911.229498:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176911.229507:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe64700 x1872931145651456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176911.229515:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145651456/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176911.229522:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176911.229524:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229526:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145651456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176911.229530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145651584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176911.229542:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176911.229547:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe64380 x1872931145651584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176911.229559:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145651584/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176911.229564:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176911.229566:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229568:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145651584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176911.229571:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145651712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176911.229581:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176911.229586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe67b80 x1872931145651712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176911.229593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145651712/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176911.229598:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176911.229599:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229601:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145651712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176911.229604:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145651840:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176911.229614:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176911.229619:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe66d80 x1872931145651840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176911.229626:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145651840/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176911.229634:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176911.229636:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145651840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176911.229641:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145651968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176911.229651:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176911.229656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe65f80 x1872931145651968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176911.229663:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145651968/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176911.229669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176911.229670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229672:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145651968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176911.229675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145652096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176911.229684:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176911.229690:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe64000 x1872931145652096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176911.229696:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145652096/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176911.229701:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176911.229703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229705:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145652096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176911.229709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145652224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176911.229718:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176911.229733:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176911/real 1786176911]  req@ffff89d99fe67100 x1872931145652224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176911.229740:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145652224/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176911.229746:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176911.229751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176911.229753:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145652224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176911.741009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176911.741076:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176912.253006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176912.764960:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176912.765056:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176913.277006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176913.789022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176913.789098:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176914.301018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176914.813021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176914.813100:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176915.325002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176915.837051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176915.837115:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176916.348963:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176916.348975:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176916.348981:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176916.348985:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176916.348994:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10650
00000100:00080000:3.0:1786176916.349002:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176916.349009:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176916.349045:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145652352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176916.349066:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176916.349069:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176916.349070:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176916.349073:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10650
00000100:00080000:3.0:1786176916.349075:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176916.349078:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176916.349085:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176916.349094:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145652352:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176916.349095:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145652480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176916.349108:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176916.349110:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176916.349111:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176916.349113:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10650
00000100:00080000:3.0:1786176916.349115:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176916.349118:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176916.349121:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176916.349133:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145652608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176916.349142:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176916.349146:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176916.349149:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176916.349153:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10650
00000800:00000100:1.0:1786176916.349156:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176916.349160:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176916.349167:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176916.349174:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176916.349188:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145652736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176916.349195:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe65180 x1872931145652352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176916.349203:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176916.349211:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176916.349213:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176916.349219:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10650
00000100:00080000:3.0:1786176916.349226:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176916.349230:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176916.349234:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145652352/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176916.349237:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176916.349250:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176916.349256:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176916.349256:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145652864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176916.349263:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145652352:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176916.349294:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176916.349298:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176916.349300:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176916.349305:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10650
00000100:00100000:1.0:1786176916.349310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145652480:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176916.349311:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176916.349320:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176916.349326:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176916.349342:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145652992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176916.349350:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176916.349360:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176916.349365:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176916.349368:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176916.349372:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe65880 x1872931145652480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176916.349376:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10650
00000100:00080000:3.0:1786176916.349383:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176916.349390:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176916.349396:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176916.349400:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145652480/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176916.349409:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176916.349411:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145653120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176916.349415:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176916.349422:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145652480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176916.349433:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145652608:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176916.349434:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176916.349440:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176916.349443:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176916.349449:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10650
00000100:00080000:3.0:1786176916.349454:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176916.349458:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176916.349463:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176916.349471:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176916.349472:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe66680 x1872931145652608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176916.349484:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145652608/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176916.349491:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145653248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176916.349493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176916.349501:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176916.349508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145652608:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176916.349514:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176916.349515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145652736:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176916.349524:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176916.349527:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176916.349533:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10650
00000800:00000100:1.0:1786176916.349538:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176916.349541:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176916.349548:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe67480 x1872931145652736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176916.349549:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176916.349559:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176916.349564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145652736/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176916.349570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176916.349573:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176916.349578:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145652736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176916.349579:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145653376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176916.349584:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145652864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176916.349603:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176916.349611:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe67800 x1872931145652864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176916.349620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145652864/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176916.349626:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176916.349628:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176916.349631:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145652864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176916.349644:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145652992:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176916.349654:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176916.349661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe64a80 x1872931145652992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176916.349668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145652992/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176916.349673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176916.349675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176916.349678:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145652992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176916.349681:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145653120:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176916.349690:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176916.349695:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe66300 x1872931145653120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176916.349720:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145653120/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176916.349725:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176916.349727:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176916.349730:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145653120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176916.349735:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145653248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176916.349748:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176916.349755:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe65180 x1872931145653248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176916.349762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145653248/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176916.349769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176916.349771:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176916.349774:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145653248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176916.349780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145653376:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176916.349799:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176916.349805:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176916/real 1786176916]  req@ffff89d99fe67100 x1872931145653376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176916.349812:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145653376/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176916.349818:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176916.349820:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176916.349822:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145653376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176916.861007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176916.861093:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176917.372991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176917.884979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176917.885038:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176918.396987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176918.909012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176918.909076:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176919.420993:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176919.932988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176919.933115:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176920.444992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176920.957037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176920.957096:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176921.468978:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176921.468980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176921.468990:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176921.468994:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176921.469005:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469014:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176921.469022:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176921.469054:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145653504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176921.469079:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176921.469082:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176921.469084:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176921.469086:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469089:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176921.469091:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176921.469099:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176921.469108:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145653632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176921.469117:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176921.469119:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176921.469122:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176921.469124:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145653504:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176921.469127:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469133:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176921.469137:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176921.469140:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176921.469148:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145653760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176921.469155:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176921.469158:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176921.469159:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176921.469161:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469163:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176921.469165:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176921.469169:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176921.469176:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145653888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176921.469182:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176921.469185:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176921.469187:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176921.469190:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469192:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176921.469195:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176921.469198:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176921.469205:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145654016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176921.469242:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176921.469246:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176921.469248:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176921.469252:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469256:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176921.469261:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145653632:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176921.469265:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176921.469274:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176921.469289:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145654144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176921.469298:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176921.469302:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176921.469304:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176921.469309:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145653760:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176921.469310:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469318:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176921.469324:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176921.469330:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176921.469342:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145654272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176921.469347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145653888:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176921.469360:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176921.469364:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176921.469366:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176921.469372:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469377:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176921.469381:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176921.469385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145654016:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786176921.469389:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176921.469406:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145654400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176921.469416:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176921.469419:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176921.469421:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176921.469425:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145654144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176921.469427:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10655
00000100:00080000:3.0:1786176921.469434:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176921.469438:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176921.469443:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176921.469453:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145654528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176921.469463:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145654272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176921.469492:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145654400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176921.469520:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145654528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176921.980964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176921.981071:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176922.492995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176923.005057:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176923.005128:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176923.517077:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176924.028990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176924.029065:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176924.540985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:0.0:1786176924.541176:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:0.0:1786176924.541232:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1786176924.541249:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176924.541295:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:0.0:1786176924.541307:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176924.541321:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176924.541333:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176924.541335:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe67100 x1872931145654528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176924.541346:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176924.541361:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176924.541371:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145654528/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:0.0:1786176924.541377:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:0.0:1786176924.541388:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176924.541401:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541408:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541415:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145654528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176924.541424:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe64700 x1872931145654144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176924.541440:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145654144/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176924.541449:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541453:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541456:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145654144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176924.541463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe66a00 x1872931145654272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176924.541492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145654272/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176924.541502:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541505:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145654272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176924.541515:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe65500 x1872931145654400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176924.541527:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145654400/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176924.541535:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541542:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145654400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176924.541548:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe65f80 x1872931145653632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176924.541560:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145653632/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176924.541567:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541574:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145653632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176924.541581:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe66d80 x1872931145653760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176924.541592:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145653760/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176924.541599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541601:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145653760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176924.541611:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe67b80 x1872931145653888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176924.541621:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145653888/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176924.541627:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145653888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176924.541640:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe64380 x1872931145654016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176924.541650:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145654016/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176924.541656:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541660:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541663:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145654016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176924.541670:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176921/real 1786176924]  req@ffff89d99fe64000 x1872931145653504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176924.541683:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145653504/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176924.541691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176924.541695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176924.541699:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145653504:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176925.053011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176925.053144:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176925.565000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176926.077006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176926.077056:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176926.589007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176926.589012:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176926.589023:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176926.589026:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589037:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00080000:3.0:1786176926.589046:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589054:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176926.589085:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145654656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176926.589109:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176926.589112:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176926.589113:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589116:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00080000:3.0:1786176926.589119:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589121:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176926.589127:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176926.589135:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145654784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176926.589145:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176926.589148:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176926.589151:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589156:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00080000:3.0:1786176926.589159:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589164:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176926.589186:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176926.589195:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145654656:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176926.589206:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145654912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176926.589220:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176926.589223:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176926.589226:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589230:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00080000:3.0:1786176926.589234:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589237:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176926.589244:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176926.589257:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145655040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176926.589267:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176926.589271:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176926.589272:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589276:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00080000:3.0:1786176926.589281:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589285:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176926.589291:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176926.589303:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176926.589307:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145655168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176926.589322:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176926.589326:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176926.589329:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589335:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00080000:3.0:1786176926.589339:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589344:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176926.589350:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176926.589366:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145655296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176926.589377:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe65180 x1872931145654656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176926.589382:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176926.589401:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176926.589416:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589422:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00100000:1.0:1786176926.589428:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145654656/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176926.589431:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589445:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176926.589458:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786176926.589463:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176926.589472:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176926.589479:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145655424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176926.589481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145654656:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176926.589512:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176926.589517:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176926.589519:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589526:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00100000:1.0:1786176926.589527:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145654784:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176926.589531:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589543:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176926.589552:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176926.589571:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145655552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176926.589581:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176926.589597:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176926.589606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe66300 x1872931145654784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176926.589606:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176926.589609:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176926.589618:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10660
00000100:00100000:1.0:1786176926.589638:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145654784/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176926.589640:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176926.589656:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786176926.589666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786176926.589668:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176926.589677:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176926.589684:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145654784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176926.589692:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145655680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176926.589731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145654912:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176926.589761:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176926.589775:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe64a80 x1872931145654912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176926.589787:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145654912/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176926.589795:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176926.589799:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176926.589803:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145654912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176926.589809:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145655040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176926.589829:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176926.589840:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe67800 x1872931145655040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176926.589851:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145655040/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176926.589858:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176926.589861:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176926.589866:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145655040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176926.589873:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145655168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176926.589891:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176926.589933:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe67480 x1872931145655168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176926.589946:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145655168/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176926.589955:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176926.589958:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176926.589962:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145655168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176926.589968:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145655296:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176926.589999:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176926.590013:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe66680 x1872931145655296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176926.590027:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145655296/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176926.590036:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176926.590040:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176926.590045:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145655296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176926.590053:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145655424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176926.590080:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176926.590095:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe65880 x1872931145655424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176926.590106:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145655424/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176926.590115:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176926.590118:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176926.590122:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145655424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176926.590129:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145655552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176926.590164:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176926.590196:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe64000 x1872931145655552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176926.590210:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145655552/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176926.590219:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176926.590222:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176926.590226:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145655552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176926.590233:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145655680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176926.590256:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176926.590268:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176926/real 1786176926]  req@ffff89d99fe64380 x1872931145655680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176926.590280:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145655680/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176926.590290:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176926.590294:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176926.590298:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145655680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176927.101022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176927.101083:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176927.613044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176928.124967:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176928.125048:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176928.637001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176929.149022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176929.149076:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176929.661005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176930.172977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176930.173045:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176930.684985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176931.196999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176931.197062:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176931.709027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176931.709043:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176931.709049:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176931.709053:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176931.709063:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709072:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176931.709080:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176931.709112:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145655808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176931.709148:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176931.709153:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176931.709155:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176931.709159:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709163:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176931.709167:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176931.709178:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176931.709182:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145655808:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176931.709192:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145655936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176931.709201:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176931.709204:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176931.709206:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176931.709210:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709213:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176931.709216:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176931.709220:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176931.709230:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145656064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176931.709238:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176931.709241:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786176931.709242:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176931.709243:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176931.709246:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709249:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176931.709252:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176931.709257:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176931.709267:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145656192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176931.709277:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176931.709280:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176931.709281:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe67b80 x1872931145655808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176931.709282:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176931.709285:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709289:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176931.709292:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176931.709296:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176931.709298:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145655808/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176931.709305:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145656320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176931.709309:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176931.709313:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176931.709314:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176931.709317:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145655808:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176931.709318:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176931.709320:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176931.709323:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709326:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176931.709329:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176931.709334:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176931.709338:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145655936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176931.709342:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145656448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176931.709352:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176931.709355:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176931.709358:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176931.709359:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176931.709362:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709365:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176931.709368:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176931.709371:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe66d80 x1872931145655936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176931.709373:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176931.709383:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145655936/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176931.709383:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145656576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176931.709393:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176931.709394:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176931.709397:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176931.709397:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176931.709399:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176931.709401:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145655936:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176931.709403:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709406:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176931.709408:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145656064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176931.709410:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176931.709414:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176931.709424:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145656704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176931.709426:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176931.709434:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176931.709436:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe65f80 x1872931145656064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176931.709437:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176931.709439:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176931.709443:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10665
00000100:00080000:3.0:1786176931.709446:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176931.709448:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145656064/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176931.709450:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176931.709454:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176931.709456:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176931.709460:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176931.709463:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145656064:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176931.709464:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145656832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176931.709469:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145656192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176931.709488:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176931.709500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe65500 x1872931145656192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176931.709513:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145656192/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176931.709519:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176931.709521:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176931.709523:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145656192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176931.709527:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145656320:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176931.709542:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176931.709549:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe66a00 x1872931145656320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176931.709557:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145656320/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176931.709562:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176931.709563:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176931.709565:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145656320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176931.709576:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145656448:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176931.709587:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176931.709594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe64700 x1872931145656448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176931.709602:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145656448/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176931.709607:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176931.709608:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176931.709610:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145656448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176931.709613:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145656576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176931.709623:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176931.709628:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe67100 x1872931145656576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176931.709635:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145656576/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176931.709645:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176931.709647:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176931.709649:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145656576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176931.709652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145656704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176931.709661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176931.709667:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe67b80 x1872931145656704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176931.709673:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145656704/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176931.709679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176931.709681:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176931.709682:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145656704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176931.709685:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145656832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176931.709694:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176931.709699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176931/real 1786176931]  req@ffff89d99fe64380 x1872931145656832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176931.709705:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145656832/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176931.709711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176931.709721:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176931.709724:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145656832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176932.220957:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176932.221033:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176932.732999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176933.244976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176933.245041:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176933.757017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176934.269010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176934.269074:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176934.781006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176935.292979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176935.293051:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176935.805035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176936.317014:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176936.317088:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176936.828968:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176936.828972:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176936.828978:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176936.828983:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176936.828992:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10671
00000100:00080000:3.0:1786176936.829001:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176936.829007:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176936.829039:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145656960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176936.829061:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176936.829063:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176936.829065:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176936.829081:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10671
00000100:00080000:3.0:1786176936.829085:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176936.829089:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176936.829096:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176936.829103:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145656960:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176936.829110:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145657088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176936.829119:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176936.829123:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176936.829124:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176936.829127:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10671
00000100:00080000:3.0:1786176936.829130:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176936.829132:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176936.829135:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176936.829144:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145657216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176936.829151:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176936.829153:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176936.829154:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176936.829160:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10671
00000800:00000100:1.0:1786176936.829161:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176936.829163:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176936.829167:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176936.829171:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176936.829180:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145657344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176936.829189:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176936.829192:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176936.829195:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176936.829197:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe64000 x1872931145656960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176936.829202:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10671
00000100:00080000:3.0:1786176936.829212:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176936.829219:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176936.829221:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145656960/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176936.829231:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176936.829233:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176936.829238:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176936.829242:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145656960:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176936.829252:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145657472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176936.829262:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145657088:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176936.829266:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176936.829271:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176936.829273:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176936.829279:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10671
00000800:00000100:1.0:1786176936.829283:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176936.829286:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176936.829293:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176936.829296:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe65880 x1872931145657088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176936.829299:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176936.829311:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145657088/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176936.829316:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145657600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176936.829323:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176936.829329:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176936.829331:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176936.829335:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145657088:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176936.829336:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176936.829341:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176936.829344:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145657216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176936.829346:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10671
00000100:00080000:3.0:1786176936.829352:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176936.829355:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176936.829358:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176936.829365:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145657728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176936.829372:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786176936.829376:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176936.829377:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176936.829380:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176936.829384:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10671
00000100:00080000:3.0:1786176936.829387:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176936.829390:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe66680 x1872931145657216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176936.829393:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176936.829399:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176936.829407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145657216/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176936.829412:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145657856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176936.829422:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176936.829428:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786176936.829429:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176936.829433:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176936.829437:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145657216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176936.829438:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176936.829446:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10671
00000100:00100000:1.0:1786176936.829449:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145657344:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786176936.829450:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176936.829458:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176936.829462:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176936.829471:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176936.829474:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145657984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176936.829482:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe67480 x1872931145657344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176936.829492:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145657344/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176936.829497:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176936.829499:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176936.829501:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145657344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176936.829512:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145657472:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176936.829523:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176936.829529:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe67800 x1872931145657472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176936.829536:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145657472/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176936.829542:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176936.829544:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176936.829553:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145657472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176936.829557:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145657600:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176936.829569:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176936.829575:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe64a80 x1872931145657600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176936.829582:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145657600/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176936.829588:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176936.829590:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176936.829592:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145657600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176936.829595:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145657728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176936.829604:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176936.829609:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe66300 x1872931145657728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176936.829616:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145657728/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176936.829621:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176936.829623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176936.829625:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145657728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176936.829629:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145657856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176936.829638:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176936.829643:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe65180 x1872931145657856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176936.829650:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145657856/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176936.829655:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176936.829657:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176936.829659:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145657856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176936.829662:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145657984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176936.829671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176936.829677:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176936/real 1786176936]  req@ffff89d99fe64000 x1872931145657984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176936.829684:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145657984/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176936.829689:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176936.829691:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176936.829693:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145657984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176937.340974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176937.341060:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176937.853035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176938.364987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176938.365038:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176938.876987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176939.388981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176939.389072:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176939.901105:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176940.413013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176940.413076:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176940.925055:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176941.437043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176941.437111:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176941.949039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176941.949039:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949050:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176941.949055:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176941.949066:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00080000:3.0:1786176941.949079:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949088:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176941.949139:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145658112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176941.949169:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949173:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176941.949175:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176941.949180:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00080000:3.0:1786176941.949184:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949190:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176941.949202:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176941.949213:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145658112:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176941.949219:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145658240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176941.949229:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949231:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176941.949232:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176941.949236:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00080000:3.0:1786176941.949239:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949242:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176941.949247:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176941.949256:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145658368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176941.949264:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949267:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176941.949269:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176941.949272:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00080000:3.0:1786176941.949275:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949277:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176941.949280:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176941.949289:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145658496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176941.949306:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176941.949307:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949313:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176941.949314:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176941.949318:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00080000:3.0:1786176941.949321:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949324:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176941.949328:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176941.949337:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145658624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176941.949343:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949346:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176941.949347:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176941.949350:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00080000:3.0:1786176941.949352:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949355:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176941.949359:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176941.949368:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe64380 x1872931145658112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176941.949369:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145658752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176941.949393:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949398:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176941.949400:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176941.949403:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00080000:3.0:1786176941.949406:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949409:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949413:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145658112/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176941.949414:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176941.949426:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145658880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176941.949429:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176941.949437:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949439:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176941.949441:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176941.949447:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176941.949451:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00100000:1.0:1786176941.949455:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145658112:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176941.949457:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949464:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176941.949469:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176941.949477:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145659008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176941.949484:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176941.949488:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786176941.949489:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145658240:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176941.949491:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176941.949499:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10676
00000100:00080000:3.0:1786176941.949501:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176941.949504:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176941.949508:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176941.949516:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145659136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176941.949526:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe67b80 x1872931145658240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176941.949549:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145658240/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176941.949557:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176941.949559:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176941.949562:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145658240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176941.949566:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145658368:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176941.949580:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949587:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe67100 x1872931145658368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176941.949597:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145658368/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176941.949608:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176941.949612:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176941.949615:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145658368:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176941.949620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145658496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176941.949637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949644:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe64700 x1872931145658496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176941.949651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145658496/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176941.949657:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176941.949659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176941.949661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145658496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176941.949665:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145658624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176941.949680:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949686:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe66a00 x1872931145658624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176941.949695:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145658624/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176941.949700:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176941.949702:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176941.949711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145658624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176941.949718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145658752:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176941.949738:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe65500 x1872931145658752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176941.949758:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145658752/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176941.949763:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176941.949766:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176941.949768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145658752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176941.949771:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145658880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176941.949786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe65f80 x1872931145658880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176941.949803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145658880/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176941.949810:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176941.949814:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176941.949817:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145658880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176941.949822:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145659008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176941.949837:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949846:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe66d80 x1872931145659008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176941.949854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145659008/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176941.949860:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176941.949863:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176941.949865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145659008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176941.949888:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145659136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176941.949932:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176941.949947:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176941/real 1786176941]  req@ffff89d99fe64380 x1872931145659136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176941.949956:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145659136/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176941.949963:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176941.949966:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176941.949969:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145659136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176942.461011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176942.461087:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176942.972992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176943.485046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176943.485114:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176943.997041:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176944.509043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176944.509146:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176945.021027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176945.533009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176945.533114:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176946.045015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176946.557008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176946.557129:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176947.069023:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069031:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176947.069034:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176947.069043:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00080000:0.0:1786176947.069052:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176947.069058:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176947.069060:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786176947.069091:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145659264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176947.069112:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069115:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176947.069116:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176947.069119:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00080000:0.0:1786176947.069121:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176947.069124:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176947.069131:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176947.069141:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145659392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176947.069150:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145659264:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176947.069151:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069159:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176947.069162:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176947.069166:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00080000:0.0:1786176947.069168:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176947.069170:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176947.069174:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176947.069183:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145659520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176947.069190:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069192:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176947.069194:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176947.069196:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00080000:0.0:1786176947.069209:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176947.069212:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176947.069215:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176947.069222:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176947.069228:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145659648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176947.069240:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069244:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176947.069246:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176947.069252:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00080000:0.0:1786176947.069256:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176947.069261:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176947.069267:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176947.069271:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f3100 x1872931145659264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176947.069284:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145659776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176947.069296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145659264/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176947.069298:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069310:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786176947.069313:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176947.069314:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176947.069321:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176947.069325:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00100000:1.0:1786176947.069329:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145659264:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176947.069333:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176947.069340:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176947.069344:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176947.069354:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145659392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176947.069358:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145659904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176947.069368:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069371:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176947.069372:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176947.069376:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00080000:0.0:1786176947.069379:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176947.069383:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176947.069386:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176947.069391:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176947.069400:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f0e00 x1872931145659392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176947.069403:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145660032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176947.069427:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069429:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176947.069431:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176947.069435:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145659392/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176947.069436:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00080000:0.0:1786176947.069441:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176947.069447:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176947.069453:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176947.069459:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786176947.069463:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145660160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176947.069472:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176947.069475:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176947.069476:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786176947.069477:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176947.069481:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10681
00000100:00080000:0.0:1786176947.069484:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786176947.069487:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145659392:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176947.069489:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176947.069495:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176947.069502:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145659520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176947.069505:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145660288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176947.069528:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176947.069539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f1500 x1872931145659520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176947.069548:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145659520/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176947.069553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176947.069556:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176947.069558:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145659520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176947.069562:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145659648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176947.069574:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176947.069579:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f3480 x1872931145659648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176947.069587:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145659648/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176947.069592:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176947.069594:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176947.069596:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145659648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176947.069599:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145659776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176947.069608:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176947.069614:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f3b80 x1872931145659776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176947.069621:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145659776/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176947.069625:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176947.069627:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176947.069629:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145659776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176947.069640:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145659904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176947.069650:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176947.069656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f0a80 x1872931145659904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176947.069664:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145659904/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176947.069669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176947.069671:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176947.069673:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145659904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176947.069676:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145660032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176947.069686:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176947.069691:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f1180 x1872931145660032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176947.069699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145660032/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176947.069704:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176947.069705:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176947.069707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145660032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176947.069710:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145660160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176947.069719:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176947.069725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f2d80 x1872931145660160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176947.069731:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145660160/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176947.069740:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176947.069742:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176947.069744:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145660160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176947.069747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145660288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176947.069756:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176947.069761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176947/real 1786176947]  req@ffff89d9870f0700 x1872931145660288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176947.069768:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145660288/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176947.069773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176947.069775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176947.069777:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145660288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176947.580986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176947.581054:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176948.092989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176948.604985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176948.605071:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176949.117007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176949.628983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176949.629079:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176950.141014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176950.653015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176950.653085:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176951.164994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176951.676977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176951.677064:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176952.189016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176952.189016:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189026:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176952.189030:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176952.189037:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10686
00000100:00080000:3.0:1786176952.189045:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176952.189051:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176952.189083:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145660416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176952.189109:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189113:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176952.189115:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176952.189118:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10686
00000100:00080000:3.0:1786176952.189122:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176952.189125:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176952.189133:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176952.189141:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145660416:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176952.189144:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145660544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176952.189156:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189158:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176952.189159:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176952.189162:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10686
00000100:00080000:3.0:1786176952.189165:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176952.189167:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176952.189170:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176952.189179:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145660672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176952.189185:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189188:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176952.189190:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176952.189192:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10686
00000100:00080000:3.0:1786176952.189194:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176952.189197:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786176952.189202:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786176952.189204:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176952.189215:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145660800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176952.189222:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189224:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176952.189226:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176952.189229:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10686
00000100:00080000:3.0:1786176952.189232:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176952.189234:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176952.189239:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe64000 x1872931145660416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176952.189239:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176952.189251:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145660928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176952.189258:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145660416/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176952.189259:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189267:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176952.189271:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176952.189279:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10686
00000100:00080000:1.0:1786176952.189281:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176952.189282:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176952.189290:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176952.189290:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176952.189297:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176952.189298:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145660416:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176952.189307:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145661056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176952.189313:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189316:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176952.189318:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176952.189322:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145660544:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176952.189324:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10686
00000100:00080000:3.0:1786176952.189331:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176952.189334:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176952.189337:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176952.189346:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145661184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176952.189351:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176952.189362:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189364:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176952.189366:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786176952.189368:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe65180 x1872931145660544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176952.189372:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10686
00000100:00080000:3.0:1786176952.189378:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176952.189384:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176952.189388:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145660544/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786176952.189388:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176952.189398:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176952.189399:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145661312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176952.189403:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176952.189406:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145660544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176952.189411:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145660672:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176952.189421:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176952.189424:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176952.189426:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176952.189430:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10686
00000800:00000100:1.0:1786176952.189435:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176952.189436:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176952.189442:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176952.189448:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176952.189449:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe66300 x1872931145660672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176952.189462:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145660672/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176952.189469:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145661440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176952.189470:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176952.189476:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176952.189482:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145660672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176952.189492:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145660800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176952.189509:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176952.189517:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe64a80 x1872931145660800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176952.189525:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145660800/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176952.189530:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176952.189532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176952.189533:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145660800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176952.189537:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145660928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176952.189547:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176952.189553:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe67800 x1872931145660928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176952.189560:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145660928/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176952.189565:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176952.189567:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176952.189568:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145660928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176952.189571:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145661056:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176952.189581:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176952.189586:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe67480 x1872931145661056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176952.189593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145661056/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176952.189602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176952.189604:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176952.189606:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145661056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176952.189617:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145661184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176952.189627:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176952.189633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe66680 x1872931145661184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176952.189639:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145661184/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176952.189645:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176952.189646:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176952.189648:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145661184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176952.189652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145661312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176952.189661:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176952.189666:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe65880 x1872931145661312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176952.189674:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145661312/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176952.189678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176952.189680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176952.189683:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145661312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176952.189686:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145661440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176952.189695:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176952.189700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176952/real 1786176952]  req@ffff89d99fe64000 x1872931145661440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176952.189706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145661440/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176952.189711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176952.189713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176952.189715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145661440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176952.700973:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176952.701059:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176953.212998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176953.724978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176953.725087:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176954.237046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176954.748985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176954.749075:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176955.261020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176955.773065:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176955.773120:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176956.285057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176956.797011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176956.797076:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176957.309014:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176957.309025:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1786176957.309027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176957.309030:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176957.309043:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309055:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176957.309064:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176957.309115:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145661568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176957.309146:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176957.309150:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176957.309151:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176957.309154:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309157:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176957.309160:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176957.309170:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176957.309180:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145661696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176957.309186:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145661568:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176957.309195:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176957.309198:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176957.309199:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176957.309203:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309205:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176957.309207:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176957.309211:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176957.309221:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145661824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176957.309228:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176957.309231:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176957.309232:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176957.309234:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309238:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176957.309240:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176957.309244:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176957.309253:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145661952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176957.309260:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176957.309263:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176957.309265:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786176957.309266:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176957.309270:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309274:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176957.309277:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176957.309281:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176957.309289:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145662080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176957.309297:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176957.309300:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176957.309302:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176957.309307:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309311:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176957.309318:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe64380 x1872931145661568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176957.309319:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176957.309329:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176957.309339:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145661568/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176957.309347:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145662208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176957.309351:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176957.309360:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176957.309363:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176957.309366:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145661568:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176957.309368:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176957.309372:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176957.309376:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309379:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176957.309383:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176957.309387:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176957.309392:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145661696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176957.309398:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145662336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176957.309407:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176957.309410:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:0.0:1786176957.309414:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176957.309415:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176957.309422:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309426:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176957.309429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe66d80 x1872931145661696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176957.309432:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176957.309438:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176957.309445:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145661696/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176957.309451:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145662464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176957.309480:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176957.309482:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176957.309486:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176957.309487:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176957.309490:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176957.309491:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145661696:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176957.309495:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10691
00000100:00080000:3.0:1786176957.309499:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176957.309501:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145661824:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176957.309505:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176957.309510:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176957.309521:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176957.309522:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145662592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176957.309531:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe65f80 x1872931145661824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176957.309540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145661824/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176957.309547:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176957.309550:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176957.309552:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145661824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176957.309556:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145661952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176957.309568:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176957.309573:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe65500 x1872931145661952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176957.309581:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145661952/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176957.309585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176957.309587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176957.309590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145661952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176957.309593:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145662080:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176957.309603:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176957.309609:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe66a00 x1872931145662080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176957.309621:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145662080/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176957.309630:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176957.309633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176957.309637:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145662080:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176957.309644:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145662208:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176957.309665:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176957.309674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe64700 x1872931145662208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176957.309683:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145662208/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176957.309688:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176957.309691:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176957.309693:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145662208:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176957.309705:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145662336:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176957.309718:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176957.309725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe67100 x1872931145662336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176957.309732:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145662336/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176957.309738:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176957.309739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176957.309741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145662336:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176957.309745:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145662464:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176957.309755:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176957.309761:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe67b80 x1872931145662464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176957.309769:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145662464/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176957.309774:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176957.309775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176957.309777:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145662464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176957.309780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145662592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176957.309789:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176957.309794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176957/real 1786176957]  req@ffff89d99fe64380 x1872931145662592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176957.309801:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145662592/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176957.309808:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176957.309810:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176957.309812:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145662592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176957.820971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176957.821056:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176958.332990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176958.845013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176958.845080:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176959.357023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176959.869027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176959.869076:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176960.381022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176960.892964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176960.893043:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786176961.405002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176961.917009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176961.917085:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786176962.428997:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429010:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176962.429015:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176962.429021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176962.429028:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429041:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176962.429050:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176962.429086:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145662720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176962.429103:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429106:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176962.429108:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176962.429112:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429115:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176962.429118:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176962.429125:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176962.429131:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145662720:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786176962.429136:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145662848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176962.429146:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429149:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176962.429150:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176962.429153:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429155:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176962.429157:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176962.429160:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176962.429170:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145662976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176962.429177:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429180:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176962.429181:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176962.429183:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429187:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176962.429189:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176962.429192:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176962.429201:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786176962.429203:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145663104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176962.429211:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429214:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176962.429215:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176962.429219:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429222:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176962.429224:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176962.429227:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176962.429234:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145663232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176962.429240:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429242:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176962.429243:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176962.429246:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429248:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176962.429251:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176962.429255:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176962.429257:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe64000 x1872931145662720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176962.429268:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145663360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176962.429280:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429283:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176962.429287:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176962.429290:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145662720/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176962.429293:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429298:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176962.429303:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176962.429310:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1786176962.429314:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176962.429320:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145663488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176962.429322:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429329:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145662720:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176962.429337:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429340:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176962.429341:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176962.429345:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429347:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176962.429349:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176962.429352:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176962.429356:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145662848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786176962.429361:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145663616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176962.429369:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176962.429372:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176962.429374:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176962.429376:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10696
00000100:00080000:3.0:1786176962.429379:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176962.429383:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176962.429385:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176962.429393:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176962.429400:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe65880 x1872931145662848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176962.429410:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145663744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176962.429414:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145662848/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176962.429439:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176962.429443:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429447:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145662848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176962.429452:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145662976:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176962.429468:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176962.429477:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe66680 x1872931145662976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176962.429486:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145662976/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176962.429491:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176962.429492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429494:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145662976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176962.429498:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145663104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176962.429509:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176962.429514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe67480 x1872931145663104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176962.429522:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145663104/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176962.429527:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176962.429529:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145663104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176962.429535:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145663232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176962.429544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176962.429549:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe67800 x1872931145663232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176962.429556:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145663232/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176962.429561:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176962.429563:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429565:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145663232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176962.429568:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145663360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176962.429577:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176962.429582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe64a80 x1872931145663360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176962.429589:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145663360/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176962.429594:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176962.429596:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429599:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145663360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176962.429602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145663488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176962.429612:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176962.429618:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe66300 x1872931145663488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176962.429625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145663488/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176962.429630:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176962.429631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145663488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176962.429645:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145663616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176962.429655:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176962.429661:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe65180 x1872931145663616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176962.429668:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145663616/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176962.429673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176962.429675:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429677:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145663616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176962.429680:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145663744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176962.429689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176962.429695:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176962/real 1786176962]  req@ffff89d99fe64000 x1872931145663744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176962.429702:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145663744/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176962.429708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176962.429710:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176962.429711:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145663744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176962.941000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176962.941122:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176963.453051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176963.965035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176963.965091:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176964.477038:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786176964.989062:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786176964.989163:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:2.0:1786176965.500975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786176966.012995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176966.013049:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176966.525015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176967.037018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176967.037050:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176967.548969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786176967.548985:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176967.548993:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786176967.548998:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176967.549008:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:3.0:1786176967.549017:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176967.549025:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786176967.549060:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145663872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176967.549094:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176967.549098:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176967.549100:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176967.549105:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:3.0:1786176967.549108:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176967.549112:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176967.549122:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176967.549137:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145664000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176967.549140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145663872:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176967.549157:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176967.549161:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176967.549163:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176967.549168:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:3.0:1786176967.549172:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176967.549176:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176967.549181:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176967.549194:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145664128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176967.549206:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176967.549206:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176967.549212:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176967.549214:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176967.549219:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:3.0:1786176967.549224:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176967.549229:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176967.549234:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176967.549247:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145664256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176967.549257:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe64380 x1872931145663872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176967.549262:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176967.549270:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176967.549273:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176967.549279:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:3.0:1786176967.549282:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176967.549288:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176967.549294:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176967.549296:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145663872/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176967.549306:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786176967.549308:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145664384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176967.549313:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176967.549322:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145663872:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786176967.549327:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176967.549331:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786176967.549334:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176967.549340:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:3.0:1786176967.549343:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786176967.549348:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176967.549353:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145664000:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786176967.549354:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786176967.549372:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145664512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176967.549384:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786176967.549387:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176967.549389:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786176967.549393:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176967.549400:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:3.0:1786176967.549405:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176967.549409:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe67b80 x1872931145664000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176967.549413:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176967.549423:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176967.549432:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145664000/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176967.549444:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176967.549448:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786176967.549449:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145664640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176967.549453:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145664000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176967.549467:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145664128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176967.549470:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786176967.549476:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786176967.549478:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786176967.549484:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:3.0:1786176967.549489:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176967.549494:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786176967.549495:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786176967.549503:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176967.549514:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe67100 x1872931145664128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786176967.549518:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145664768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786176967.549545:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176967.549549:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145664128/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786176967.549550:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786176967.549554:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176967.549563:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786176967.549564:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10701
00000100:00080000:0.0:1786176967.549570:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786176967.549571:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176967.549575:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145664128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786176967.549581:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176967.549586:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145664256:192.168.202.130@tcp:8:kworker.0
00000008:00100000:3.0:1786176967.549589:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786176967.549606:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145664896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176967.549617:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176967.549633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe64700 x1872931145664256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176967.549647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145664256/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176967.549656:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176967.549659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176967.549663:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145664256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176967.549669:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145664384:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176967.549689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176967.549714:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe66a00 x1872931145664384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176967.549726:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145664384/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176967.549734:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176967.549738:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176967.549741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145664384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176967.549768:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145664512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176967.549804:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176967.549816:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe65500 x1872931145664512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176967.549828:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145664512/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176967.549836:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176967.549839:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176967.549852:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145664512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176967.549859:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145664640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176967.549880:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176967.549892:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe65f80 x1872931145664640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176967.549935:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145664640/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176967.549945:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176967.549948:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176967.549951:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145664640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176967.549958:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145664768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176967.549980:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176967.549992:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe66d80 x1872931145664768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176967.550006:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145664768/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176967.550016:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176967.550020:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176967.550023:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145664768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176967.550029:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145664896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176967.550049:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176967.550061:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176967/real 1786176967]  req@ffff89d99fe64380 x1872931145664896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176967.550074:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145664896/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176967.550083:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176967.550087:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176967.550090:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145664896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176968.061022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176968.061083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176968.573057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176969.084996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176969.085067:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176969.596997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176970.109024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176970.109102:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176970.621015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176971.132964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176971.133092:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786176971.645016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176972.157048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176972.157116:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176972.669019:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669027:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1786176972.669030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176972.669032:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669044:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669053:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669059:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176972.669092:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145665024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176972.669115:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669117:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176972.669119:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669121:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669124:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669126:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176972.669133:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176972.669140:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145665152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176972.669152:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669154:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176972.669155:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669158:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669159:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669161:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176972.669164:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176972.669173:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145665280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176972.669181:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669184:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176972.669186:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669188:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669189:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669192:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176972.669196:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176972.669202:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145665408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176972.669213:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145665024:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176972.669215:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669230:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176972.669232:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669236:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669239:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669244:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176972.669247:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176972.669256:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145665536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176972.669262:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669264:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176972.669265:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669267:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669269:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669272:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176972.669276:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176972.669283:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145665664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176972.669288:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669292:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176972.669293:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669296:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669298:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669301:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176972.669305:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786176972.669309:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176972.669319:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145665792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176972.669331:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669333:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176972.669334:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669338:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669342:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669345:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176972.669347:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176972.669354:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145665920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176972.669361:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176972.669363:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176972.669364:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176972.669370:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10706
00000100:00080000:2.0:1786176972.669372:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176972.669374:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176972.669377:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176972.669384:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145666048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176972.669394:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87ed80 x1872931145665024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669421:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145665024/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669431:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669434:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669437:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145665024:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786176972.669444:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145665152:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176972.669466:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176972.669477:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87c700 x1872931145665152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669485:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145665152/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669492:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669494:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669496:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145665152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176972.669500:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145665280:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176972.669511:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176972.669517:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87c380 x1872931145665280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669524:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145665280/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669530:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669533:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145665280:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176972.669557:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145665408:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176972.669568:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176972.669574:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87ca80 x1872931145665408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669582:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145665408/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669588:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669590:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669592:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145665408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176972.669596:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145665536:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176972.669606:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176972.669611:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87dc00 x1872931145665536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669619:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145665536/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669624:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669626:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669627:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145665536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176972.669631:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145665664:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176972.669640:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176972.669646:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87e680 x1872931145665664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669652:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145665664/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669658:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669660:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669663:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145665664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176972.669666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145665792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176972.669676:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176972.669681:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87d880 x1872931145665792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145665792/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669693:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669695:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669697:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145665792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176972.669701:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145665920:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176972.669710:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176972.669716:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87f800 x1872931145665920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669747:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145665920/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669754:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669756:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669758:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145665920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176972.669763:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145666048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176972.669778:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176972.669786:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176972/real 1786176972]  req@ffff89d99e87df80 x1872931145666048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176972.669793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145666048/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786176997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176972.669806:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176972.669808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176972.669810:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145666048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176973.181006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176973.181079:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176973.693011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176974.205024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176974.205096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176974.717040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176975.229031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176975.229128:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176975.741009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176976.253035:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176976.253135:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176976.764992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176977.277029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176977.277096:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176977.788996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176977.788998:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176977.789008:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176977.789012:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176977.789024:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00080000:2.0:1786176977.789036:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789045:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176977.789092:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145666176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176977.789117:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176977.789121:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176977.789122:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176977.789125:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00080000:2.0:1786176977.789128:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789130:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176977.789140:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176977.789150:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145666304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176977.789158:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176977.789163:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786176977.789164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145666176:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176977.789165:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176977.789174:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00080000:2.0:1786176977.789177:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789179:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176977.789183:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176977.789192:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145666432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176977.789199:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176977.789202:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176977.789204:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176977.789207:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00080000:2.0:1786176977.789209:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789211:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176977.789215:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176977.789222:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145666560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176977.789228:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176977.789230:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176977.789232:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176977.789234:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00080000:2.0:1786176977.789237:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789241:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786176977.789246:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786176977.789248:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176977.789258:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145666688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176977.789266:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176977.789268:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176977.789270:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176977.789272:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00080000:2.0:1786176977.789274:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789277:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176977.789281:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176977.789289:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145666816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176977.789296:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176977.789298:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176977.789300:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176977.789304:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87d500 x1872931145666176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176977.789305:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00080000:2.0:1786176977.789311:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789317:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176977.789323:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176977.789330:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145666176/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176977.789333:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145666944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176977.789355:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176977.789356:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176977.789359:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176977.789361:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176977.789362:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176977.789367:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00100000:0.0:1786176977.789369:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145666176:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176977.789371:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789377:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176977.789380:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176977.789387:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145667072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176977.789396:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176977.789397:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145666304:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176977.789401:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176977.789405:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176977.789409:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10712
00000100:00080000:2.0:1786176977.789411:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176977.789413:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176977.789417:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176977.789423:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176977.789427:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145667200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176977.789437:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87c000 x1872931145666304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176977.789449:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145666304/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176977.789456:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176977.789458:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176977.789462:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145666304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176977.789467:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145666432:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176977.789480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176977.789487:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87f100 x1872931145666432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176977.789495:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145666432/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176977.789502:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176977.789504:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176977.789506:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145666432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176977.789510:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145666560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176977.789525:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176977.789534:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87df80 x1872931145666560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176977.789544:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145666560/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176977.789551:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176977.789553:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176977.789555:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145666560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176977.789559:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145666688:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176977.789570:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176977.789578:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87f800 x1872931145666688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176977.789593:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145666688/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176977.789602:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176977.789607:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176977.789611:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145666688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176977.789619:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145666816:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176977.789644:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176977.789662:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87d880 x1872931145666816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176977.789687:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145666816/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176977.789694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176977.789696:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176977.789700:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145666816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176977.789705:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145666944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176977.789722:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176977.789732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87e680 x1872931145666944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176977.789742:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145666944/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176977.789755:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176977.789758:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176977.789761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145666944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176977.789777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145667072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176977.789790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176977.789797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87dc00 x1872931145667072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176977.789806:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145667072/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176977.789812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176977.789816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176977.789818:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145667072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176977.789824:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145667200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176977.789835:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176977.789842:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176977/real 1786176977]  req@ffff89d99e87ca80 x1872931145667200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176977.789849:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145667200/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176977.789854:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176977.789856:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176977.789858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145667200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176978.300993:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176978.301075:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176978.813022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176979.325020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176979.325114:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176979.837001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176980.348983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176980.349125:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176980.861017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176981.373030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176981.373065:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176981.884952:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176982.397022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176982.397084:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786176982.908996:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176982.908999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786176982.909005:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786176982.909009:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176982.909018:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00080000:2.0:1786176982.909028:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176982.909036:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786176982.909074:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145667328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176982.909097:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176982.909100:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176982.909101:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176982.909104:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00080000:2.0:1786176982.909107:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176982.909110:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176982.909119:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176982.909131:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145667328:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786176982.909131:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145667456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176982.909150:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176982.909152:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176982.909153:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176982.909156:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00080000:2.0:1786176982.909158:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176982.909160:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176982.909164:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176982.909173:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145667584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176982.909180:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176982.909184:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176982.909186:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176982.909190:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00080000:2.0:1786176982.909194:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786176982.909196:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176982.909202:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176982.909209:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176982.909223:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145667712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176982.909233:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176982.909237:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176982.909238:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176982.909243:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87c380 x1872931145667328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176982.909244:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00080000:2.0:1786176982.909250:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176982.909258:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176982.909263:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176982.909268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145667328/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786176982.909274:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145667840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176982.909282:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176982.909285:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176982.909289:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176982.909290:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786176982.909293:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786176982.909295:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145667328:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786176982.909299:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00080000:2.0:1786176982.909304:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176982.909307:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176982.909310:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176982.909316:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145667968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786176982.909324:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786176982.909326:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145667456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176982.909327:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786176982.909331:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176982.909338:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00080000:2.0:1786176982.909340:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176982.909343:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176982.909346:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786176982.909355:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145668096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786176982.909367:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786176982.909367:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786176982.909372:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786176982.909375:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786176982.909379:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00080000:2.0:1786176982.909382:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786176982.909384:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176982.909388:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87c700 x1872931145667456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786176982.909390:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786176982.909403:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145668224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176982.909406:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145667456/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786176982.909420:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176982.909424:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786176982.909425:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786176982.909428:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176982.909432:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786176982.909436:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10717
00000100:00100000:0.0:1786176982.909437:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145667456:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176982.909443:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786176982.909447:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145667584:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786176982.909452:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786176982.909459:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786176982.909470:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786176982.909476:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145668352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786176982.909481:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87ed80 x1872931145667584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176982.909506:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145667584/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176982.909518:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176982.909522:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176982.909525:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145667584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176982.909532:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145667712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176982.909554:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176982.909567:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87ca80 x1872931145667712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176982.909575:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145667712/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176982.909585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176982.909588:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176982.909590:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145667712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176982.909593:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145667840:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176982.909607:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176982.909613:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87dc00 x1872931145667840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176982.909620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145667840/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176982.909653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176982.909656:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176982.909658:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145667840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176982.909672:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145667968:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176982.909687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176982.909694:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87e680 x1872931145667968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176982.909702:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145667968/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176982.909707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176982.909709:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176982.909712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145667968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176982.909715:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145668096:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786176982.909725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176982.909731:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87d880 x1872931145668096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176982.909738:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145668096/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176982.909743:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176982.909746:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176982.909749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145668096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176982.909755:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145668224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176982.909774:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176982.909786:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87f800 x1872931145668224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176982.909798:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145668224/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176982.909806:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176982.909808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176982.909810:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145668224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786176982.909814:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145668352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786176982.909828:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176982.909837:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176982/real 1786176982]  req@ffff89d99e87df80 x1872931145668352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176982.909850:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145668352/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176982.909858:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176982.909861:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176982.909865:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145668352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176983.421008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176983.421100:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176983.933049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176984.445019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176984.445084:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176984.956998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176985.469018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176985.469084:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176985.981008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176986.492988:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176986.493066:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176987.004975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176987.517017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176987.517092:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176988.029013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176988.029041:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029047:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176988.029051:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029061:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00080000:0.0:1786176988.029071:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029076:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176988.029110:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145668480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176988.029136:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029139:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176988.029140:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029143:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00080000:0.0:1786176988.029145:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029150:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176988.029158:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176988.029168:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145668608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176988.029177:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029181:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176988.029187:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029191:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00100000:1.0:1786176988.029191:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145668480:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176988.029201:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029206:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176988.029210:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176988.029220:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145668736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176988.029226:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029228:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176988.029229:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029232:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00080000:0.0:1786176988.029234:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029236:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176988.029238:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176988.029246:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145668864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176988.029252:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029255:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176988.029256:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029259:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00080000:0.0:1786176988.029269:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029271:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176988.029275:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176988.029286:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145668992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176988.029292:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029294:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176988.029295:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029297:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00080000:0.0:1786176988.029299:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029301:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176988.029304:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176988.029311:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145669120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176988.029327:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029332:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176988.029334:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029339:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00080000:0.0:1786176988.029345:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029350:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176988.029356:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145668608:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176988.029359:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176988.029387:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145669248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176988.029401:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145668736:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786176988.029405:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029411:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176988.029414:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029422:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00100000:1.0:1786176988.029426:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145668864:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176988.029429:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029436:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176988.029446:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176988.029463:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145669376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176988.029464:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145668992:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786176988.029486:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176988.029489:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176988.029491:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176988.029496:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10722
00000100:00080000:0.0:1786176988.029500:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176988.029503:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176988.029507:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176988.029511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145669120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176988.029517:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145669504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176988.029558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145669248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176988.029593:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145669376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176988.029620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145669504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176988.541012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176988.541078:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176989.052964:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176989.565015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176989.565083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176990.077014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176990.588957:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176990.589045:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176991.100976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786176991.101122:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786176991.101171:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786176991.101188:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176991.101236:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786176991.101252:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176991.101265:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176991.101278:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176991.101279:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f3480 x1872931145669504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176991.101290:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786176991.101305:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786176991.101316:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145669504/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786176991.101324:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176991.101339:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:2.0:1786176991.101344:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786176991.101348:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101356:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145669504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176991.101366:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f2680 x1872931145668608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176991.101381:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145668608/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176991.101389:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176991.101393:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101397:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145668608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176991.101404:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f1880 x1872931145668736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176991.101416:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145668736/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176991.101424:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176991.101428:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101431:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145668736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176991.101437:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f0700 x1872931145668864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176991.101447:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145668864/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176991.101454:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176991.101457:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101460:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145668864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176991.101466:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f2d80 x1872931145668992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176991.101476:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145668992/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176991.101482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176991.101486:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101489:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145668992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176991.101495:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f1180 x1872931145669120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176991.101505:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145669120/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176991.101512:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176991.101516:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101519:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145669120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176991.101524:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f2a00 x1872931145668480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176991.101534:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145668480/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176991.101541:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176991.101580:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101583:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145668480:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786176991.101620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f0a80 x1872931145669248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176991.101632:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145669248/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176991.101640:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176991.101643:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145669248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176991.101654:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176988/real 1786176991]  req@ffff89d9870f3b80 x1872931145669376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176991.101665:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145669376/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176991.101673:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176991.101676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176991.101679:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145669376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176991.613007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176991.613087:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176992.125039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176992.636959:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176992.637092:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176993.149015:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176993.149015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176993.149026:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176993.149032:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176993.149044:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:0.0:1786176993.149056:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176993.149066:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176993.149113:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145669632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176993.149139:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176993.149142:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176993.149144:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176993.149147:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:0.0:1786176993.149151:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176993.149155:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176993.149166:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176993.149178:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145669760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176993.149178:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145669632:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176993.149194:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176993.149198:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176993.149200:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176993.149205:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:0.0:1786176993.149209:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176993.149215:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176993.149220:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176993.149234:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145669888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176993.149244:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176993.149248:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176993.149250:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176993.149254:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:0.0:1786176993.149259:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176993.149262:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176993.149268:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786176993.149274:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786176993.149286:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145670016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176993.149297:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176993.149301:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176993.149303:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176993.149307:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:0.0:1786176993.149312:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176993.149317:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176993.149322:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176993.149334:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f1500 x1872931145669632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786176993.149337:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145670144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176993.149349:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176993.149359:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176993.149362:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176993.149367:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:0.0:1786176993.149371:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176993.149376:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176993.149380:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145669632/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176993.149383:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176993.149400:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145670272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786176993.149400:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176993.149411:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176993.149420:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145669632:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176993.149421:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176993.149429:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176993.149432:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176993.149438:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:0.0:1786176993.149442:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176993.149446:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176993.149453:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786176993.149458:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145669760:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176993.149469:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145670400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176993.149482:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176993.149486:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176993.149489:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786176993.149495:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176993.149499:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:0.0:1786176993.149506:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176993.149511:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176993.149518:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f0e00 x1872931145669760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786176993.149519:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176993.149554:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145670528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176993.149589:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176993.149595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145669760/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176993.149596:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176993.149601:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176993.149613:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10727
00000100:00080000:1.0:1786176993.149615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176993.149619:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176993.149623:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786176993.149629:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786176993.149631:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145669760:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786176993.149639:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176993.149643:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145669888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176993.149658:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145670656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176993.149672:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176993.149687:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f3100 x1872931145669888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176993.149699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145669888/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176993.149707:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176993.149711:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176993.149714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145669888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176993.149720:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145670016:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176993.149741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176993.149753:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f3b80 x1872931145670016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176993.149765:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145670016/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176993.149787:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176993.149792:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176993.149795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145670016:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176993.149802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145670144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176993.149825:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176993.149838:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f0a80 x1872931145670144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176993.149852:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145670144/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176993.149861:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176993.149864:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176993.149868:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145670144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176993.149874:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145670272:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176993.149925:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176993.149939:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f2a00 x1872931145670272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176993.149952:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145670272/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176993.149961:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176993.149965:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176993.149968:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145670272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176993.149989:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145670400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176993.150011:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176993.150023:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f1180 x1872931145670400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176993.150035:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145670400/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176993.150048:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176993.150051:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176993.150054:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145670400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176993.150059:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145670528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176993.150078:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176993.150089:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f2d80 x1872931145670528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176993.150101:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145670528/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176993.150109:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176993.150112:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176993.150115:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145670528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176993.150121:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145670656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176993.150140:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176993.150152:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176993/real 1786176993]  req@ffff89d9870f0700 x1872931145670656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176993.150163:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145670656/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176993.150170:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176993.150173:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176993.150177:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145670656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176993.661052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786176993.661114:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176994.173033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176994.685042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176994.685121:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176995.197005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176995.709031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176995.709096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176996.220999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176996.733023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176996.733084:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176997.244988:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176997.756996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176997.757060:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786176998.269009:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1786176998.269015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786176998.269017:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786176998.269022:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269031:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269039:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176998.269045:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786176998.269079:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145670784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176998.269100:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176998.269103:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176998.269104:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269107:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269109:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176998.269112:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176998.269119:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176998.269128:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145670912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176998.269145:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786176998.269146:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145670784:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176998.269151:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786176998.269154:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269163:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269166:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176998.269168:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176998.269172:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176998.269182:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145671040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176998.269188:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176998.269191:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176998.269192:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269194:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269197:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176998.269199:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176998.269203:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176998.269211:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145671168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176998.269217:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176998.269220:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176998.269221:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269223:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269226:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786176998.269231:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786176998.269232:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176998.269239:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786176998.269246:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145671296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176998.269252:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176998.269255:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786176998.269256:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269259:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269261:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176998.269263:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176998.269267:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176998.269274:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145671424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786176998.269281:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176998.269284:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786176998.269285:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f1880 x1872931145670784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176998.269286:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269292:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269296:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176998.269301:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176998.269306:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786176998.269315:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145671552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176998.269321:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145670784/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786176998.269324:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176998.269332:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786176998.269335:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269342:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269345:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786176998.269345:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786176998.269350:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176998.269354:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786176998.269356:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786176998.269362:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145671680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786176998.269366:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145670784:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786176998.269374:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786176998.269378:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786176998.269379:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786176998.269382:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10732
00000100:00080000:0.0:1786176998.269384:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786176998.269388:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786176998.269392:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786176998.269399:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145670912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786176998.269406:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145671808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786176998.269430:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176998.269446:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f2680 x1872931145670912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176998.269461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145670912/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176998.269470:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176998.269505:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176998.269508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145670912:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176998.269513:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145671040:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176998.269530:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176998.269539:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f3480 x1872931145671040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176998.269547:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145671040/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176998.269552:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176998.269555:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176998.269557:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145671040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176998.269561:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145671168:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176998.269572:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176998.269577:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f0700 x1872931145671168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176998.269585:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145671168/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176998.269590:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176998.269591:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176998.269593:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145671168:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176998.269596:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145671296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176998.269606:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176998.269611:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f2d80 x1872931145671296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176998.269631:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145671296/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176998.269639:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176998.269642:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176998.269645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145671296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176998.269652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145671424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176998.269668:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176998.269677:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f1180 x1872931145671424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176998.269688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145671424/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176998.269696:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176998.269699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176998.269702:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145671424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176998.269708:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145671552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786176998.269729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176998.269741:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f2a00 x1872931145671552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176998.269754:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145671552/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176998.269768:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176998.269772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176998.269775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145671552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786176998.269782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145671680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176998.269803:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176998.269817:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f0a80 x1872931145671680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176998.269830:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145671680/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176998.269839:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176998.269843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176998.269846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145671680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786176998.269869:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145671808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786176998.269890:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786176998.269922:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786176998/real 1786176998]  req@ffff89d9870f3b80 x1872931145671808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786176998.269935:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145671808/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786176998.269943:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786176998.269946:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786176998.269949:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145671808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786176998.781027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176998.781077:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786176999.292978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786176999.804944:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786176999.805028:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177000.317016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177000.829004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177000.829075:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177001.341008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177001.853012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177001.853072:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177002.365016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177002.877004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177002.877075:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177003.389018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177003.389031:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177003.389043:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177003.389049:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177003.389062:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00080000:3.0:1786177003.389083:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177003.389093:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177003.389143:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145671936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177003.389176:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177003.389180:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177003.389182:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177003.389186:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00080000:3.0:1786177003.389191:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177003.389195:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177003.389206:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177003.389218:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145672064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177003.389231:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177003.389237:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786177003.389241:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145671936:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177003.389241:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177003.389254:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00080000:3.0:1786177003.389258:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177003.389263:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177003.389270:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177003.389289:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145672192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177003.389299:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177003.389303:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177003.389306:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177003.389310:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00080000:3.0:1786177003.389316:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177003.389321:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177003.389329:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786177003.389335:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177003.389368:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145672320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177003.389378:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe64000 x1872931145671936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177003.389384:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177003.389398:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177003.389401:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177003.389413:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00080000:3.0:1786177003.389420:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177003.389440:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145671936/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177003.389446:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177003.389459:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177003.389468:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177003.389479:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177003.389488:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145671936:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786177003.389493:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145672448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177003.389507:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177003.389511:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177003.389514:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177003.389520:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00100000:1.0:1786177003.389526:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145672064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177003.389528:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177003.389540:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177003.389548:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177003.389566:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145672576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177003.389574:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177003.389593:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177003.389598:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177003.389600:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177003.389608:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe65180 x1872931145672064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177003.389610:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00080000:3.0:1786177003.389619:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177003.389631:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177003.389640:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177003.389648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145672064/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177003.389660:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145672704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177003.389669:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786177003.389678:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177003.389684:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786177003.389687:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177003.389692:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177003.389696:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145672064:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177003.389712:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00100000:1.0:1786177003.389713:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145672192:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177003.389722:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177003.389733:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177003.389740:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177003.389753:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786177003.389760:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145672832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177003.389774:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe66300 x1872931145672192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177003.389796:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177003.389807:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786177003.389808:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145672192/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177003.389812:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177003.389826:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10737
00000100:00080000:1.0:1786177003.389835:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786177003.389835:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177003.389850:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177003.389852:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177003.389866:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145672192:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786177003.389866:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177003.389887:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145672320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177003.389891:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145672960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177003.389976:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177003.389990:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe64a80 x1872931145672320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177003.390001:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145672320/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177003.390009:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177003.390012:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177003.390015:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145672320:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177003.390021:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145672448:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177003.390039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177003.390048:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe67800 x1872931145672448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177003.390064:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145672448/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177003.390071:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177003.390074:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177003.390077:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145672448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177003.390096:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145672576:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177003.390116:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177003.390129:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe67480 x1872931145672576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177003.390143:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145672576/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177003.390153:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177003.390157:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177003.390161:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145672576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177003.390169:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145672704:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177003.390193:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177003.390208:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe66680 x1872931145672704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177003.390221:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145672704/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177003.390237:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177003.390241:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177003.390246:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145672704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177003.390253:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145672832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177003.390278:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177003.390293:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe65880 x1872931145672832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177003.390305:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145672832/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177003.390313:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177003.390316:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177003.390319:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145672832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177003.390325:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145672960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177003.390343:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177003.390353:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177003/real 1786177003]  req@ffff89d99fe64000 x1872931145672960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177003.390364:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145672960/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177003.390371:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177003.390374:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177003.390377:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145672960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177003.901037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177003.901106:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177004.413052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177004.925010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177004.925103:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177005.437035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177005.948994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177005.949062:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177006.461021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177006.972999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177006.973065:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177007.485020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177007.996974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177007.997048:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177008.508985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786177008.508998:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177008.509004:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786177008.509008:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177008.509017:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00080000:1.0:1786177008.509025:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177008.509032:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177008.509065:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145673088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177008.509090:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177008.509093:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177008.509094:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177008.509097:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00080000:1.0:1786177008.509100:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177008.509102:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177008.509109:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177008.509119:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145673216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177008.509130:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177008.509133:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177008.509135:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177008.509140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145673088:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786177008.509144:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00080000:1.0:1786177008.509150:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177008.509155:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177008.509161:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177008.509177:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145673344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177008.509185:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177008.509188:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177008.509190:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177008.509192:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00080000:1.0:1786177008.509195:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177008.509199:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177008.509203:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177008.509210:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177008.509213:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145673472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177008.509221:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177008.509224:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177008.509226:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177008.509229:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00080000:1.0:1786177008.509231:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177008.509234:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177008.509237:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177008.509245:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145673600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177008.509251:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2ffb80 x1872931145673088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177008.509253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177008.509260:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177008.509261:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177008.509265:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00080000:1.0:1786177008.509269:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177008.509275:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177008.509279:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177008.509284:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145673088/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177008.509289:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145673728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177008.509304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177008.509305:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177008.509310:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177008.509312:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177008.509313:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177008.509318:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145673088:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786177008.509322:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00080000:1.0:1786177008.509327:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177008.509330:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145673216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177008.509335:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177008.509351:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786177008.509357:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177008.509369:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2fc380 x1872931145673216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177008.509373:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145673856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177008.509407:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145673216/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177008.509408:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177008.509419:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177008.509424:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177008.509424:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177008.509432:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177008.509436:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00100000:0.0:1786177008.509437:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145673216:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177008.509445:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177008.509452:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177008.509459:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177008.509467:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145673344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177008.509474:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145673984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177008.509487:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786177008.509488:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177008.509494:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177008.509497:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177008.509501:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2ff100 x1872931145673344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177008.509506:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10742
00000100:00080000:1.0:1786177008.509516:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177008.509518:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145673344/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177008.509524:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786177008.509528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1786177008.509533:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786177008.509534:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177008.509539:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145673344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177008.509546:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145673472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177008.509554:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145674112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177008.509564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177008.509574:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2fd180 x1872931145673472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177008.509584:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145673472/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177008.509594:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177008.509597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177008.509599:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145673472:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177008.509602:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145673600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177008.509613:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177008.509618:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2fed80 x1872931145673600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177008.509625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145673600/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177008.509630:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177008.509632:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177008.509634:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145673600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177008.509637:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145673728:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177008.509654:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177008.509662:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2fea00 x1872931145673728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177008.509669:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145673728/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177008.509675:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177008.509676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177008.509679:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145673728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177008.509683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145673856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177008.509693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177008.509699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2fdf80 x1872931145673856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177008.509706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145673856/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177008.509711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177008.509713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177008.509715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145673856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177008.509727:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145673984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177008.509737:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177008.509743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2ff800 x1872931145673984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177008.509750:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145673984/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177008.509756:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177008.509757:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177008.509759:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145673984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177008.509762:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145674112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177008.509771:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177008.509777:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177008/real 1786177008]  req@ffff89d9ba2fc380 x1872931145674112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177008.509784:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145674112/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177008.509790:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177008.509791:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177008.509793:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145674112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177009.021022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177009.021095:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177009.533016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177010.044982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177010.045078:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177010.556999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177011.069003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177011.069083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177011.581000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177012.093012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177012.093071:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177012.604973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177013.117027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177013.117114:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786177013.629007:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629015:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177013.629019:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177013.629023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177013.629028:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:2.0:1786177013.629037:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177013.629045:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177013.629077:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145674240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177013.629099:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629103:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177013.629104:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177013.629107:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:2.0:1786177013.629110:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177013.629113:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177013.629121:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177013.629132:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145674368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177013.629137:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145674240:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177013.629149:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629153:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177013.629154:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177013.629159:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:2.0:1786177013.629162:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177013.629165:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177013.629169:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177013.629180:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145674496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177013.629188:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629191:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177013.629192:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177013.629195:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:2.0:1786177013.629199:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786177013.629203:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177013.629204:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177013.629210:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177013.629219:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145674624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177013.629227:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629230:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177013.629231:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177013.629235:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:2.0:1786177013.629239:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177013.629245:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629246:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87f100 x1872931145674240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177013.629250:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177013.629264:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145674752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177013.629268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145674240/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177013.629277:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629283:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177013.629285:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177013.629287:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177013.629290:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:0.0:1786177013.629295:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177013.629295:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177013.629302:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629304:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145674240:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786177013.629306:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177013.629316:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145674880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177013.629322:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629339:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786177013.629340:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145674368:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177013.629342:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177013.629350:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:2.0:1786177013.629354:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177013.629358:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177013.629362:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786177013.629371:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177013.629376:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145675008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177013.629386:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87c000 x1872931145674368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177013.629391:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629397:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1786177013.629400:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145674368/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177013.629402:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177013.629412:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:0.0:1786177013.629414:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177013.629419:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177013.629420:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177013.629427:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145674368:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177013.629431:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145674496:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786177013.629437:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177013.629454:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145675136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177013.629461:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177013.629469:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177013.629472:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786177013.629476:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87d500 x1872931145674496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177013.629476:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177013.629484:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10747
00000100:00080000:2.0:1786177013.629491:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177013.629496:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145674496/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177013.629498:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177013.629505:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786177013.629507:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177013.629512:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177013.629516:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145675264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177013.629518:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145674496:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177013.629530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145674624:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177013.629546:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629555:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87df80 x1872931145674624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177013.629568:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145674624/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177013.629573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177013.629576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177013.629586:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145674624:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177013.629597:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145674752:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177013.629610:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629617:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87f800 x1872931145674752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177013.629624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145674752/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177013.629629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177013.629631:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177013.629633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145674752:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177013.629636:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145674880:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177013.629646:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629651:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87d880 x1872931145674880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177013.629658:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145674880/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177013.629667:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177013.629669:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177013.629671:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145674880:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177013.629683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145675008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177013.629693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87e680 x1872931145675008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177013.629706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145675008/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177013.629711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177013.629713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177013.629715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145675008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177013.629718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145675136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177013.629727:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629733:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87dc00 x1872931145675136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177013.629739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145675136/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177013.629744:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177013.629746:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177013.629749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145675136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177013.629752:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145675264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177013.629761:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177013.629766:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177013/real 1786177013]  req@ffff89d99e87ca80 x1872931145675264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177013.629773:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145675264/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177013.629779:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177013.629780:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177013.629782:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145675264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177014.141019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177014.141090:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177014.652997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177015.165032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177015.165101:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177015.677034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177016.189066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177016.189138:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177016.700981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177017.213003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177017.213086:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177017.725019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177018.236999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177018.237124:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177018.748985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177018.749027:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177018.749036:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177018.749041:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177018.749052:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749063:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177018.749071:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177018.749117:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145675392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177018.749148:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177018.749152:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177018.749153:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177018.749156:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749159:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177018.749161:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177018.749172:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177018.749183:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145675520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177018.749190:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177018.749193:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177018.749195:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177018.749198:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749200:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177018.749203:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177018.749207:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177018.749216:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145675648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177018.749222:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145675392:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177018.749225:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177018.749231:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177018.749233:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177018.749236:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749238:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177018.749241:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177018.749244:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177018.749254:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145675776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177018.749261:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177018.749263:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177018.749264:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177018.749267:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749270:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177018.749273:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177018.749293:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177018.749302:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145675904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177018.749310:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177018.749314:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177018.749316:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786177018.749321:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177018.749326:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749333:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177018.749338:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177018.749344:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177018.749358:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145676032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177018.749377:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177018.749381:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87ed80 x1872931145675392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177018.749382:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177018.749386:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177018.749394:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749400:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177018.749408:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177018.749415:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177018.749420:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145675392/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177018.749428:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145676160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177018.749432:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177018.749439:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177018.749441:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177018.749444:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177018.749447:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177018.749448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145675392:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177018.749453:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749457:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177018.749460:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145675520:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177018.749464:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177018.749469:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177018.749478:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145676288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177018.749486:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786177018.749488:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177018.749491:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177018.749494:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177018.749499:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10752
00000100:00080000:2.0:1786177018.749502:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177018.749503:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87c700 x1872931145675520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177018.749509:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177018.749513:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177018.749522:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145676416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177018.749529:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145675520/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177018.749540:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177018.749544:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177018.749548:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145675520:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177018.749578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145675648:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177018.749599:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177018.749613:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87c380 x1872931145675648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177018.749624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145675648/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177018.749638:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177018.749641:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177018.749645:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145675648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177018.749650:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145675776:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177018.749671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177018.749682:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87ca80 x1872931145675776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177018.749696:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145675776/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177018.749702:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177018.749704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177018.749707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145675776:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177018.749711:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145675904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177018.749729:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177018.749739:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87dc00 x1872931145675904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177018.749752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145675904/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177018.749760:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177018.749763:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177018.749768:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145675904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177018.749775:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145676032:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177018.749796:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177018.749805:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87e680 x1872931145676032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177018.749813:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145676032/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177018.749818:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177018.749820:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177018.749823:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145676032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177018.749826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145676160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177018.749837:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177018.749844:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87d880 x1872931145676160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177018.749851:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145676160/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177018.749856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177018.749858:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177018.749860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145676160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177018.749863:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145676288:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177018.749872:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177018.749879:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87f800 x1872931145676288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177018.749886:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145676288/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177018.749892:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177018.749893:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177018.749895:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145676288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177018.749920:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145676416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177018.749933:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177018.749940:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177018/real 1786177018]  req@ffff89d99e87df80 x1872931145676416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177018.749948:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145676416/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177018.749953:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177018.749956:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177018.749958:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145676416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177019.261018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177019.261145:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177019.772995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177020.285011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177020.285079:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177020.796975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177021.309004:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177021.309073:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177021.820997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177022.333060:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177022.333353:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177022.844984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177023.357013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177023.357090:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786177023.868988:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177023.868989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177023.869000:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177023.869005:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177023.869015:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10758
00000100:00080000:2.0:1786177023.869026:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177023.869033:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177023.869067:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145676544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177023.869090:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177023.869093:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177023.869095:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177023.869097:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10758
00000100:00080000:2.0:1786177023.869100:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177023.869102:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177023.869110:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177023.869118:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145676672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177023.869127:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177023.869132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145676544:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177023.869132:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177023.869135:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177023.869141:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10758
00000100:00080000:2.0:1786177023.869144:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177023.869146:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177023.869149:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177023.869157:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145676800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177023.869164:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177023.869167:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177023.869168:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177023.869170:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10758
00000100:00080000:2.0:1786177023.869172:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177023.869174:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177023.869178:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177023.869185:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145676928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177023.869191:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177023.869193:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177023.869194:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177023.869200:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10758
00000800:00000100:0.0:1786177023.869201:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177023.869203:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177023.869207:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177023.869212:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177023.869221:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145677056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177023.869239:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177023.869242:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177023.869244:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177023.869247:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10758
00000100:00080000:2.0:1786177023.869250:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177023.869253:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177023.869258:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177023.869262:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87d500 x1872931145676544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177023.869270:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145677184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177023.869279:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177023.869282:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177023.869284:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177023.869286:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145676544/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177023.869296:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10758
00000100:00080000:2.0:1786177023.869303:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177023.869307:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177023.869310:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786177023.869316:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786177023.869318:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177023.869324:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145676544:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177023.869336:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145677312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177023.869350:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177023.869354:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145676672:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177023.869356:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177023.869360:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177023.869366:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10758
00000100:00080000:2.0:1786177023.869369:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177023.869372:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177023.869377:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177023.869388:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177023.869390:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145677440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177023.869398:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177023.869400:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786177023.869404:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87c000 x1872931145676672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177023.869404:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177023.869413:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10758
00000100:00080000:2.0:1786177023.869421:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177023.869424:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145676672/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177023.869430:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786177023.869434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177023.869439:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786177023.869439:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177023.869444:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145676672:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177023.869459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145676800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177023.869460:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145677568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177023.869478:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177023.869489:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87f100 x1872931145676800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177023.869498:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145676800/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177023.869504:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177023.869506:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177023.869508:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145676800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177023.869511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145676928:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177023.869522:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177023.869527:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87df80 x1872931145676928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177023.869535:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145676928/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177023.869540:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177023.869541:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177023.869543:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145676928:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177023.869546:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145677056:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177023.869556:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177023.869562:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87f800 x1872931145677056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177023.869574:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145677056/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177023.869588:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177023.869591:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177023.869594:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145677056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177023.869600:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145677184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177023.869622:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177023.869635:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87d880 x1872931145677184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177023.869648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145677184/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177023.869667:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177023.869670:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177023.869674:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145677184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177023.869690:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145677312:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177023.869706:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177023.869715:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87e680 x1872931145677312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177023.869723:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145677312/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177023.869728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177023.869730:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177023.869732:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145677312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177023.869736:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145677440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177023.869746:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177023.869752:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87dc00 x1872931145677440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177023.869759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145677440/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177023.869764:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177023.869765:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177023.869767:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145677440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177023.869770:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145677568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177023.869779:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177023.869788:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177023/real 1786177023]  req@ffff89d99e87ca80 x1872931145677568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177023.869801:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145677568/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177023.869809:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177023.869813:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177023.869816:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145677568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177024.381015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177024.381075:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177024.893022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177025.405042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177025.405096:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177025.916994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177026.429017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177026.429070:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177026.941029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177027.452997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177027.453068:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177027.964973:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177028.477036:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177028.477129:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177028.989016:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177028.989031:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177028.989043:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177028.989050:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177028.989063:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00080000:2.0:1786177028.989076:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177028.989085:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177028.989148:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145677696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177028.989203:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177028.989207:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177028.989210:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177028.989220:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00080000:2.0:1786177028.989225:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177028.989230:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177028.989243:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177028.989250:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145677696:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177028.989263:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145677824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177028.989279:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177028.989283:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177028.989286:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177028.989290:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00080000:2.0:1786177028.989298:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177028.989303:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177028.989309:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786177028.989321:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177028.989328:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145677952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177028.989342:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177028.989347:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177028.989350:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177028.989357:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00080000:2.0:1786177028.989362:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177028.989366:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177028.989373:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177028.989376:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87c380 x1872931145677696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177028.989391:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145678080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177028.989396:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145677696/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177028.989448:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177028.989453:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177028.989457:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145677696:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177028.989457:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177028.989470:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177028.989473:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177028.989481:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00080000:2.0:1786177028.989487:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177028.989493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145677824:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177028.989494:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177028.989511:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177028.989527:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177028.989535:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145678208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177028.989540:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87c700 x1872931145677824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177028.989592:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177028.989596:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145677824/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177028.989604:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177028.989610:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177028.989615:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177028.989621:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00080000:0.0:1786177028.989622:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177028.989632:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177028.989633:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145677824:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177028.989647:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145677952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177028.989647:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177028.989671:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786177028.989673:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177028.989682:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87ed80 x1872931145677952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177028.989692:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145678336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177028.989694:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145677952/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177028.989756:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177028.989769:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177028.989775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145677952:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177028.989781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145678080:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177028.989803:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786177028.989809:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177028.989811:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177028.989815:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177028.989820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87ca80 x1872931145678080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177028.989829:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00080000:2.0:1786177028.989846:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177028.989848:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145678080/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177028.989861:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177028.989861:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786177028.989871:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177028.989876:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145678080:192.168.202.130@tcp:8:kworker.0
00000008:00100000:2.0:1786177028.989877:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177028.989892:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145678208:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177028.989930:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177028.989937:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145678464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177028.989942:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87dc00 x1872931145678208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177028.989996:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177028.990000:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145678208/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177028.990006:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177028.990015:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177028.990017:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177028.990025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177028.990028:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00100000:0.0:1786177028.990033:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145678208:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177028.990037:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177028.990041:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145678336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177028.990048:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177028.990056:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177028.990061:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177028.990071:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87e680 x1872931145678336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177028.990077:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145678592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177028.990097:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145678336/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177028.990121:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177028.990121:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177028.990137:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177028.990138:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177028.990144:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177028.990147:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145678336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177028.990152:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10763
00000100:00080000:2.0:1786177028.990162:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177028.990168:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177028.990174:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177028.990191:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145678464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177028.990205:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145678720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177028.990223:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177028.990240:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87d880 x1872931145678464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177028.990253:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145678464/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177028.990260:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177028.990263:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177028.990265:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145678464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177028.990270:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145678592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177028.990284:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177028.990291:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87f800 x1872931145678592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177028.990299:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145678592/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177028.990304:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177028.990306:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177028.990308:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145678592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177028.990317:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145678720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177028.990327:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177028.990334:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177028/real 1786177028]  req@ffff89d99e87df80 x1872931145678720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177028.990341:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145678720/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177053 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177028.990346:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177028.990348:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177028.990351:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145678720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177029.501095:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177029.501105:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177030.012994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786177030.525016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177030.525119:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177031.037007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177031.549045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177031.549115:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177032.061040:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177032.572987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177032.573055:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177033.085031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177033.597052:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177033.597120:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177034.109017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177034.109023:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177034.109029:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177034.109032:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177034.109042:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109051:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177034.109060:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177034.109099:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145678848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177034.109123:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177034.109126:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177034.109142:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177034.109145:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109148:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177034.109151:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177034.109159:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177034.109171:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145678976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177034.109180:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177034.109183:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145678848:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177034.109183:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177034.109187:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177034.109194:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109197:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177034.109199:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177034.109202:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177034.109212:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145679104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177034.109223:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177034.109226:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177034.109228:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177034.109232:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109237:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177034.109241:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177034.109247:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177034.109252:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786177034.109266:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145679232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177034.109275:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177034.109278:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177034.109279:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177034.109283:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109286:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177034.109291:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe64380 x1872931145678848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177034.109292:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177034.109300:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177034.109312:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145679360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177034.109321:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145678848/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177034.109322:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177034.109336:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177034.109338:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177034.109339:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786177034.109343:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109347:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177034.109350:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786177034.109353:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177034.109358:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145678848:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786177034.109360:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177034.109375:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145679488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177034.109385:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145678976:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177034.109389:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177034.109394:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177034.109397:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177034.109402:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109406:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177034.109410:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177034.109416:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786177034.109426:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786177034.109432:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145679616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177034.109443:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177034.109445:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe66d80 x1872931145678976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177034.109449:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177034.109455:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177034.109465:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109469:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177034.109474:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145678976/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177034.109475:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177034.109483:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786177034.109486:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177034.109492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786177034.109495:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145679744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177034.109498:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145678976:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177034.109511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145679104:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177034.109514:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177034.109518:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177034.109519:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177034.109523:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10768
00000100:00080000:3.0:1786177034.109526:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177034.109529:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177034.109533:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177034.109538:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786177034.109547:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145679872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177034.109552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe65f80 x1872931145679104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177034.109582:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145679104/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177034.109593:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177034.109597:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177034.109600:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145679104:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177034.109607:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145679232:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177034.109631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177034.109643:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe65500 x1872931145679232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177034.109657:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145679232/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177034.109666:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177034.109669:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177034.109672:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145679232:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177034.109677:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145679360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177034.109692:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177034.109701:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe66a00 x1872931145679360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177034.109714:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145679360/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177034.109722:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177034.109725:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177034.109728:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145679360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177034.109747:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145679488:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177034.109766:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177034.109778:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe64700 x1872931145679488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177034.109791:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145679488/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177034.109800:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177034.109803:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177034.109807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145679488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177034.109813:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145679616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177034.109829:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177034.109838:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe67100 x1872931145679616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177034.109850:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145679616/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177034.109856:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177034.109858:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177034.109860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145679616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177034.109863:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145679744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177034.109876:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177034.109886:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe67b80 x1872931145679744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177034.109939:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145679744/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177034.109945:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177034.109948:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177034.109950:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145679744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177034.109955:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145679872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177034.109976:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177034.109989:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177034/real 1786177034]  req@ffff89d99fe64380 x1872931145679872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177034.110002:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145679872/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177034.110022:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177034.110025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177034.110027:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145679872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177034.621010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177034.621072:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177035.133008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177035.645019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177035.645079:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177036.156998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177036.668994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177036.669060:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177037.181056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177037.693075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177037.693152:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177038.204955:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786177038.716996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177038.717120:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786177039.229057:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177039.229059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177039.229071:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177039.229093:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229106:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10773
00000100:00080000:3.0:1786177039.229120:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177039.229130:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177039.229190:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145680000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177039.229233:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177039.229238:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177039.229240:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229245:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10773
00000100:00080000:3.0:1786177039.229249:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177039.229254:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177039.229266:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177039.229280:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145680128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177039.229284:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145680000:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177039.229301:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177039.229304:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177039.229306:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229311:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10773
00000100:00080000:3.0:1786177039.229315:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177039.229319:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177039.229325:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177039.229338:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145680256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177039.229349:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177039.229353:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177039.229355:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229359:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10773
00000800:00000100:0.0:1786177039.229364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177039.229365:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177039.229372:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177039.229379:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177039.229394:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145680384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177039.229405:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177039.229409:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177039.229412:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229417:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10773
00000100:00100000:0.0:1786177039.229420:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe64000 x1872931145680000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177039.229431:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177039.229438:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177039.229442:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145680000/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786177039.229446:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786177039.229457:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.229464:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786177039.229465:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145680512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177039.229469:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145680000:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177039.229482:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177039.229486:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177039.229488:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229493:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10773
00000100:00100000:0.0:1786177039.229497:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145680128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177039.229497:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177039.229513:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786177039.229519:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786177039.229520:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177039.229531:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe65880 x1872931145680128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177039.229539:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145680640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177039.229546:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145680128/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177039.229568:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.229576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786177039.229579:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177039.229580:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145680128:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177039.229589:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786177039.229592:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145680256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177039.229593:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229602:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10773
00000100:00080000:3.0:1786177039.229607:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177039.229612:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786177039.229615:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786177039.229621:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177039.229626:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe66680 x1872931145680256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177039.229639:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145680768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177039.229640:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145680256/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177039.229652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.229661:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786177039.229667:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177039.229669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145680256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177039.229671:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177039.229674:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229682:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10773
00000100:00080000:3.0:1786177039.229687:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177039.229691:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145680384:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786177039.229692:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177039.229701:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177039.229719:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145680896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177039.229728:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177039.229737:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177039.229743:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786177039.229746:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe67480 x1872931145680384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177039.229747:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177039.229758:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10773
00000100:00080000:3.0:1786177039.229763:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177039.229766:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145680384/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177039.229770:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177039.229781:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786177039.229783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.229789:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177039.229794:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145680384:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177039.229803:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145680512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177039.229804:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145681024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177039.229821:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177039.229830:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe67800 x1872931145680512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177039.229840:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145680512/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177039.229846:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.229849:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177039.229851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145680512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177039.229866:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145680640:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177039.229878:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177039.229884:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe64a80 x1872931145680640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177039.229891:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145680640/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177039.229919:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.229921:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177039.229923:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145680640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177039.229928:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145680768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177039.229941:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177039.229949:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe66300 x1872931145680768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177039.229968:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145680768/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177039.229977:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.229980:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177039.229983:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145680768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177039.229990:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145680896:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177039.230011:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177039.230022:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe65180 x1872931145680896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177039.230030:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145680896/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177039.230036:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.230039:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177039.230041:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145680896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177039.230045:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145681024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177039.230056:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177039.230062:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177039/real 1786177039]  req@ffff89d99fe64000 x1872931145681024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177039.230070:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145681024/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177039.230076:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177039.230092:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177039.230094:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145681024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177039.741131:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177039.741190:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177040.253029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177040.765016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177040.765103:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177041.276995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177041.789012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177041.789082:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177042.301006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177042.813017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177042.813114:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177043.324981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177043.837022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177043.837107:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177044.349018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177044.349164:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177044.349171:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177044.349176:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177044.349186:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00080000:2.0:1786177044.349195:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177044.349203:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177044.349242:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145681152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177044.349271:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177044.349275:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177044.349277:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177044.349282:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00080000:2.0:1786177044.349286:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177044.349290:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177044.349300:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177044.349314:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145681280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177044.349324:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145681152:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177044.349343:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177044.349347:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177044.349349:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177044.349355:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00080000:2.0:1786177044.349360:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177044.349364:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177044.349371:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177044.349386:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145681408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177044.349389:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177044.349402:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177044.349407:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177044.349409:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177044.349414:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00080000:2.0:1786177044.349418:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177044.349422:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177044.349427:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177044.349429:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87f100 x1872931145681152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177044.349443:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145681536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177044.349448:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145681152/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177044.349466:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177044.349472:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177044.349473:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177044.349477:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177044.349482:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177044.349487:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00100000:0.0:1786177044.349492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145681152:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177044.349495:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177044.349504:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177044.349510:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177044.349523:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145681664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177044.349525:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145681280:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177044.349543:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177044.349547:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177044.349549:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177044.349555:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00080000:2.0:1786177044.349560:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786177044.349565:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177044.349567:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177044.349575:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177044.349588:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87c000 x1872931145681280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177044.349592:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145681792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177044.349627:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177044.349631:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786177044.349634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145681280/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177044.349634:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177044.349644:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00080000:0.0:1786177044.349652:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177044.349652:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177044.349659:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786177044.349660:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177044.349666:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145681280:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786177044.349670:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177044.349685:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145681920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177044.349686:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145681408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177044.349711:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177044.349715:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177044.349717:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786177044.349723:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177044.349728:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00080000:2.0:1786177044.349735:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177044.349740:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177044.349744:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87d500 x1872931145681408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177044.349748:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177044.349762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145681408/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177044.349769:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145682048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177044.349771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177044.349779:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177044.349785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145681408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177044.349795:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177044.349796:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145681536:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177044.349805:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177044.349808:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177044.349814:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10778
00000100:00080000:2.0:1786177044.349818:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786177044.349823:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177044.349827:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177044.349834:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177044.349841:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87df80 x1872931145681536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177044.349850:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145682176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177044.349863:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145681536/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177044.349874:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177044.349879:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177044.349883:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145681536:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177044.349927:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145681664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177044.349947:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177044.349959:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87f800 x1872931145681664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177044.349972:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145681664/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177044.349981:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177044.349984:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177044.349988:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145681664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177044.349995:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145681792:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177044.350012:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177044.350020:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87d880 x1872931145681792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177044.350044:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145681792/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177044.350052:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177044.350054:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177044.350056:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145681792:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177044.350061:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145681920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177044.350075:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177044.350083:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87e680 x1872931145681920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177044.350091:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145681920/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177044.350096:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177044.350098:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177044.350100:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145681920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177044.350104:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145682048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177044.350121:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177044.350128:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87dc00 x1872931145682048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177044.350136:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145682048/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177044.350141:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177044.350143:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177044.350145:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145682048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177044.350149:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145682176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177044.350160:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177044.350166:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177044/real 1786177044]  req@ffff89d99e87ca80 x1872931145682176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177044.350173:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145682176/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177044.350179:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177044.350181:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177044.350183:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145682176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177044.861008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177044.861086:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177045.373039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177045.884994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177045.885071:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177046.396967:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177046.909021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177046.909097:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177047.420982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177047.933044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177047.933116:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177048.445028:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786177048.957015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177048.957109:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786177049.469059:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177049.469067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177049.469073:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177049.469079:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177049.469091:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10783
00000100:00080000:3.0:1786177049.469102:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177049.469110:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177049.469148:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145682304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177049.469180:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177049.469186:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177049.469189:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177049.469194:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10783
00000100:00080000:3.0:1786177049.469199:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177049.469205:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177049.469216:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177049.469234:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145682304:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786177049.469236:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145682432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177049.469258:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177049.469263:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177049.469265:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177049.469270:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10783
00000100:00080000:3.0:1786177049.469276:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177049.469281:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177049.469287:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177049.469370:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145682560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177049.469373:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177049.469388:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177049.469392:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177049.469395:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177049.469400:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10783
00000100:00080000:3.0:1786177049.469405:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177049.469410:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177049.469417:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177049.469430:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe64380 x1872931145682304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177049.469452:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145682304/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177049.469464:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.469470:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177049.469476:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145682304:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177049.469502:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145682432:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177049.469533:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177049.469548:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe67b80 x1872931145682432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177049.469564:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145682688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177049.469566:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145682432/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177049.469589:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.469593:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177049.469599:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145682432:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177049.469608:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145682560:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177049.469636:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177049.469638:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177049.469644:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177049.469647:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177049.469655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe67100 x1872931145682560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177049.469655:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10783
00000100:00080000:3.0:1786177049.469665:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177049.469676:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145682560/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177049.469688:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177049.469691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.469696:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:3.0:1786177049.469697:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177049.469700:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145682560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786177049.469716:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145682816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177049.469718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145682688:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786177049.469735:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177049.469739:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177049.469741:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786177049.469742:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177049.469752:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10783
00000100:00100000:1.0:1786177049.469757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe64700 x1872931145682688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177049.469758:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177049.469768:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177049.469774:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145682688/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786177049.469777:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177049.469785:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.469789:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177049.469791:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145682688:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177049.469798:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145682944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177049.469802:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145682816:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786177049.469819:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177049.469824:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177049.469827:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786177049.469829:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177049.469837:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10783
00000100:00100000:1.0:1786177049.469842:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe66a00 x1872931145682816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177049.469845:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177049.469854:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177049.469857:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145682816/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786177049.469864:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177049.469866:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.469871:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177049.469873:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145682816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177049.469883:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145683072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177049.469886:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145682944:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177049.469941:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177049.469945:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786177049.469951:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177049.469951:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177049.469961:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10783
00000100:00080000:3.0:1786177049.469967:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177049.469971:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe65500 x1872931145682944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177049.469973:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177049.469999:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177049.470005:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145682944/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177049.470013:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.470017:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786177049.470020:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145683200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177049.470021:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145682944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177049.470035:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145683072:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177049.470039:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177049.470044:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177049.470046:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177049.470053:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10783
00000800:00000100:1.0:1786177049.470056:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177049.470061:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177049.470069:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177049.470070:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe65f80 x1872931145683072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786177049.470078:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177049.470082:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145683072/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177049.470089:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.470092:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177049.470099:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145683072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786177049.470100:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145683328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177049.470108:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145683200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177049.470128:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177049.470137:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe66d80 x1872931145683200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177049.470145:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145683200/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177049.470150:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.470152:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177049.470155:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145683200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177049.470161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145683328:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177049.470171:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177049.470176:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177049/real 1786177049]  req@ffff89d99fe65500 x1872931145683328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177049.470183:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145683328/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177049.470189:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177049.470190:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177049.470192:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145683328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177049.981047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177049.981105:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177050.493029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786177051.005130:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177051.005164:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786177051.516992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177052.029025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177052.029096:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177052.541037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177053.053042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177053.053109:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177053.565012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177054.077015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177054.077087:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177054.589011:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177054.589023:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589031:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177054.589036:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177054.589047:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00080000:0.0:1786177054.589056:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177054.589064:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177054.589103:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145683456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177054.589132:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589136:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177054.589138:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177054.589144:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00080000:0.0:1786177054.589149:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177054.589154:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177054.589161:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145683456:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786177054.589165:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177054.589191:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145683584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177054.589204:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177054.589210:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177054.589215:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00080000:0.0:1786177054.589219:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177054.589223:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177054.589228:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177054.589242:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145683712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177054.589253:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589257:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177054.589259:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177054.589263:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00080000:0.0:1786177054.589269:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177054.589269:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145683584:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177054.589278:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177054.589286:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177054.589301:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145683840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177054.589310:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145683712:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177054.589329:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589334:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177054.589336:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177054.589342:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00080000:0.0:1786177054.589347:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177054.589348:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145683840:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177054.589355:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177054.589363:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177054.589378:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145683968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177054.589396:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589400:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177054.589403:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177054.589414:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145683968:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177054.589418:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00080000:0.0:1786177054.589428:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177054.589434:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177054.589441:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177054.589456:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145684096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177054.589473:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589477:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177054.589480:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177054.589488:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00100000:1.0:1786177054.589488:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145684096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177054.589497:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177054.589504:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177054.589510:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177054.589524:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145684224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177054.589547:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589551:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177054.589553:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177054.589557:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00080000:0.0:1786177054.589561:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177054.589566:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177054.589571:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177054.589573:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145684224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177054.589586:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145684352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177054.589599:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177054.589603:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177054.589605:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177054.589609:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10788
00000100:00080000:0.0:1786177054.589615:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177054.589619:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177054.589625:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177054.589631:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145684352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177054.589639:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145684480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177054.589669:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145684480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177055.101021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177055.101090:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177055.612996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177056.124997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177056.125075:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177056.637019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:1.0:1786177057.149032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177057.149085:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177057.660989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:3.0:1786177057.661260:0:2379:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:3.0:1786177057.661295:0:2379:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1786177057.661308:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786177057.661411:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f3100 x1872931145683456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177079 ref 2 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.661446:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145683456/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177079 ref 2 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.661459:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.661465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.661469:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145683456:192.168.202.130@tcp:250:kworker.0
00000800:00000100:3.0:1786177057.661542:0:2379:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:3.0:1786177057.661567:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786177057.661577:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786177057.661585:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786177057.661593:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786177057.661602:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786177057.661610:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:3.0:1786177057.661618:0:2379:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786177057.661675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f0700 x1872931145684480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.661692:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145684480/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.661709:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.661714:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.661717:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145684480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177057.661725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f2d80 x1872931145684352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.661739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145684352/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.661748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.661751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.661755:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145684352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177057.661762:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f1180 x1872931145684224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.661783:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145684224/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.661791:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.661795:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.661798:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145684224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177057.661806:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f2a00 x1872931145684096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.661819:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145684096/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.661827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.661831:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.661834:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145684096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177057.661841:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f0a80 x1872931145683968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.661852:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145683968/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.661860:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.661862:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.661866:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145683968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177057.661872:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f3b80 x1872931145683840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.661933:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145683840/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.661942:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.661946:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.661949:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145683840:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177057.661956:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f0e00 x1872931145683584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.661969:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145683584/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.661978:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.661981:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.661984:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145683584:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177057.661990:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177054/real 1786177057]  req@ffff89d9870f1500 x1872931145683712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177057.662001:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145683712/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177057.662008:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177057.662012:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177057.662016:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145683712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177058.172966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177058.173049:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177058.685015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177059.197040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177059.197059:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177059.708985:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177059.709051:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709058:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177059.709062:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709072:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709081:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709089:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177059.709132:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145684608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177059.709175:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709180:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177059.709182:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709186:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709190:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709194:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177059.709204:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177059.709217:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145684736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177059.709227:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709236:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177059.709238:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709242:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709246:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709250:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177059.709254:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177059.709267:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145684864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177059.709276:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709280:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177059.709282:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709285:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709289:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709292:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177059.709296:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177059.709307:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145684992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177059.709316:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709319:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177059.709321:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709325:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709328:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709331:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177059.709335:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177059.709345:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145685120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177059.709361:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709365:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177059.709366:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709371:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709374:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709378:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177059.709383:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177059.709408:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145685248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177059.709418:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709422:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177059.709423:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709427:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709431:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709435:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177059.709439:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177059.709449:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145685376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177059.709458:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709462:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177059.709464:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709468:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709472:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709477:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177059.709482:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177059.709492:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145685504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177059.709502:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177059.709506:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177059.709507:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177059.709512:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10793
00000100:00080000:3.0:1786177059.709516:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177059.709520:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177059.709525:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177059.709536:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145685632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177059.709630:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145684608:192.168.202.130@tcp:250:kworker.0
00000800:00000100:1.0:1786177059.709701:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.709743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe66a00 x1872931145684608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.709759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145684608/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.709769:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.709772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.709776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145684608:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177059.709783:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145684736:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177059.709806:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.709819:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe64700 x1872931145684736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.709833:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145684736/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.709841:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.709845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.709849:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145684736:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177059.709855:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145684864:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177059.709875:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.709922:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe67100 x1872931145684864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.709937:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145684864/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.709946:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.709950:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.709954:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145684864:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177059.709960:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145684992:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177059.709982:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.709994:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe67b80 x1872931145684992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.710006:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145684992/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.710015:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.710018:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.710021:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145684992:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177059.710028:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145685120:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177059.710047:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.710059:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe64380 x1872931145685120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.710071:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145685120/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.710080:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.710083:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.710086:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145685120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177059.710092:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145685248:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177059.710107:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.710115:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe64000 x1872931145685248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.710127:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145685248/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.710142:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.710146:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.710150:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145685248:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177059.710156:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145685376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177059.710176:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.710187:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe65180 x1872931145685376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.710198:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145685376/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.710205:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.710208:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.710210:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145685376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177059.710215:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145685504:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177059.710234:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.710245:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe66300 x1872931145685504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.710258:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145685504/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.710265:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.710268:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.710272:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145685504:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177059.710278:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145685632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177059.710299:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177059.710311:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177059/real 1786177059]  req@ffff89d99fe64a80 x1872931145685632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177059.710323:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145685632/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177059.710331:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177059.710334:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177059.710338:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145685632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177060.221017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177060.221072:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177060.733002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177061.245016:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177061.245069:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177061.757005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177062.269009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177062.269089:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177062.781008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177063.293008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177063.293066:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177063.805006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177064.317019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177064.317077:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786177064.829005:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177064.829013:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177064.829017:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177064.829025:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829033:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829040:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177064.829053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:0.0:1786177064.829073:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145685760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177064.829099:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177064.829102:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177064.829103:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177064.829106:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829109:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829112:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177064.829120:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177064.829126:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145685760:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177064.829131:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145685888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177064.829140:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177064.829142:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177064.829144:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177064.829147:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829149:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829151:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177064.829154:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177064.829162:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145686016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177064.829169:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177064.829171:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177064.829172:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177064.829174:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829188:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829190:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177064.829194:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177064.829199:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177064.829207:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145686144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177064.829215:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177064.829217:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177064.829219:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177064.829221:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829224:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829226:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177064.829229:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177064.829237:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145686272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177064.829242:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f3480 x1872931145685760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177064.829248:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177064.829255:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177064.829258:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177064.829262:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829266:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829269:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177064.829272:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177064.829275:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145685760/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177064.829281:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145686400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177064.829286:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177064.829290:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177064.829294:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177064.829297:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177064.829302:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177064.829302:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145685760:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177064.829311:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829315:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829317:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177064.829321:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177064.829327:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145686528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177064.829333:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145685888:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177064.829339:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177064.829342:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177064.829344:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177064.829348:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829357:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829362:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177064.829362:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786177064.829370:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177064.829378:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f2680 x1872931145685888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177064.829380:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145686656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177064.829405:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177064.829410:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786177064.829410:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145685888/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177064.829411:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177064.829417:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10799
00000100:00080000:0.0:1786177064.829421:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177064.829427:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177064.829432:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177064.829435:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786177064.829440:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145686784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177064.829452:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177064.829458:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145685888:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177064.829466:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145686016:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177064.829483:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177064.829492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f1880 x1872931145686016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177064.829501:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145686016/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177064.829506:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177064.829509:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177064.829511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145686016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177064.829514:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145686144:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177064.829530:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177064.829542:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f1500 x1872931145686144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177064.829555:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145686144/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177064.829564:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177064.829568:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177064.829571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145686144:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177064.829578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145686272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177064.829598:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177064.829611:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f0e00 x1872931145686272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177064.829624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145686272/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177064.829633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177064.829635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177064.829638:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145686272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177064.829642:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145686400:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177064.829657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177064.829665:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f3b80 x1872931145686400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177064.829672:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145686400/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177064.829678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177064.829679:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177064.829682:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145686400:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177064.829694:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145686528:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177064.829705:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177064.829711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f0a80 x1872931145686528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177064.829719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145686528/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177064.829724:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177064.829725:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177064.829727:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145686528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177064.829731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145686656:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177064.829741:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177064.829746:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f2a00 x1872931145686656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177064.829754:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145686656/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177064.829758:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177064.829760:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177064.829763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145686656:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177064.829766:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145686784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177064.829774:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177064.829779:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177064/real 1786177064]  req@ffff89d9870f1180 x1872931145686784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177064.829786:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145686784/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177064.829791:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177064.829793:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177064.829795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145686784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177065.341002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177065.341064:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177065.853023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177066.364995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177066.365095:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177066.877022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177067.389041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177067.389132:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177067.901009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177068.413010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177068.413091:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177068.925029:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177069.437008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786177069.437046:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786177069.949003:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177069.949004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177069.949013:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177069.949017:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177069.949026:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949034:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177069.949041:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177069.949074:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145686912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177069.949096:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177069.949099:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177069.949101:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177069.949103:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949105:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177069.949108:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177069.949115:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177069.949125:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145687040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177069.949134:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177069.949135:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145686912:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177069.949137:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177069.949140:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177069.949147:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949150:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177069.949152:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177069.949154:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177069.949169:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145687168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177069.949176:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177069.949179:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177069.949180:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177069.949183:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949196:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177069.949198:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177069.949202:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177069.949207:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177069.949211:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145687296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177069.949219:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177069.949221:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177069.949223:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177069.949226:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949228:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177069.949230:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177069.949233:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177069.949240:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145687424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177069.949247:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177069.949248:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f2d80 x1872931145686912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177069.949250:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177069.949253:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177069.949260:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949272:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177069.949275:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145686912/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177069.949278:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177069.949284:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177069.949292:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145687552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177069.949308:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177069.949309:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177069.949315:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177069.949316:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177069.949319:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177069.949323:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145686912:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177069.949328:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949333:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177069.949338:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177069.949344:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177069.949345:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145687040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177069.949359:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145687680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177069.949369:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177069.949372:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177069.949375:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786177069.949376:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177069.949380:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949384:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177069.949388:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177069.949392:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177069.949398:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f0700 x1872931145687040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177069.949403:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145687808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177069.949425:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145687040/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177069.949430:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177069.949437:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177069.949440:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177069.949445:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177069.949446:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10804
00000100:00080000:0.0:1786177069.949452:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177069.949454:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177069.949458:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177069.949461:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145687040:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177069.949467:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145687168:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786177069.949471:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177069.949483:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145687936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177069.949491:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177069.949504:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f3100 x1872931145687168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177069.949512:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145687168/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177069.949518:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177069.949521:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177069.949523:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145687168:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177069.949527:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145687296:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177069.949538:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177069.949544:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f1180 x1872931145687296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177069.949552:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145687296/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177069.949557:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177069.949558:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177069.949560:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145687296:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177069.949564:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145687424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177069.949573:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177069.949582:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f2a00 x1872931145687424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177069.949595:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145687424/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177069.949604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177069.949607:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177069.949611:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145687424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177069.949618:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145687552:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177069.949638:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177069.949650:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f0a80 x1872931145687552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177069.949662:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145687552/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177069.949667:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177069.949669:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177069.949672:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145687552:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177069.949685:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145687680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177069.949699:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177069.949706:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f3b80 x1872931145687680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177069.949713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145687680/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177069.949718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177069.949720:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177069.949722:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145687680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177069.949725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145687808:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177069.949735:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177069.949740:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f0e00 x1872931145687808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177069.949748:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145687808/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177069.949753:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177069.949754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177069.949757:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145687808:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177069.949760:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145687936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177069.949769:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177069.949774:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177069/real 1786177069]  req@ffff89d9870f1500 x1872931145687936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177069.949800:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145687936/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177069.949807:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177069.949808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177069.949811:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145687936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177070.460971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177070.461042:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177070.973030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177071.484986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177071.485065:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177071.997020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177072.509027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177072.509093:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177073.021049:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177073.532998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177073.533107:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177074.045002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177074.557003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177074.557080:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177075.068980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177075.069010:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177075.069015:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177075.069020:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177075.069034:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10809
00000100:00080000:0.0:1786177075.069042:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177075.069048:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177075.069079:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145688064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177075.069101:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177075.069104:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177075.069107:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177075.069111:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10809
00000100:00080000:0.0:1786177075.069116:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177075.069121:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177075.069131:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177075.069134:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145688064:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177075.069149:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145688192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177075.069163:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177075.069167:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177075.069169:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177075.069175:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10809
00000100:00080000:0.0:1786177075.069188:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177075.069193:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177075.069199:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177075.069200:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177075.069216:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145688320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177075.069237:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177075.069241:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177075.069243:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177075.069246:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10809
00000100:00080000:0.0:1786177075.069251:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177075.069256:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177075.069258:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f1880 x1872931145688064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177075.069261:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177075.069278:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145688448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177075.069282:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145688064/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177075.069297:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177075.069301:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177075.069302:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177075.069306:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069309:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145688064:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177075.069310:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177075.069318:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10809
00000100:00080000:0.0:1786177075.069321:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177075.069324:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177075.069327:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177075.069335:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145688192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177075.069338:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145688576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177075.069348:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177075.069351:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177075.069354:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177075.069358:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10809
00000800:00000100:1.0:1786177075.069362:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177075.069366:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177075.069373:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177075.069376:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f2680 x1872931145688192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177075.069381:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177075.069388:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145688192/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177075.069395:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177075.069398:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069401:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145688192:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177075.069409:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145688320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177075.069411:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145688704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177075.069424:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177075.069426:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177075.069432:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177075.069435:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177075.069439:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f3480 x1872931145688320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177075.069444:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10809
00000100:00080000:0.0:1786177075.069452:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177075.069457:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145688320/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177075.069461:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177075.069472:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177075.069472:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177075.069478:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145688320:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177075.069487:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145688448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177075.069491:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145688832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177075.069503:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177075.069504:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177075.069509:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177075.069512:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177075.069516:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f1500 x1872931145688448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177075.069520:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10809
00000100:00080000:0.0:1786177075.069527:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177075.069532:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145688448/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177075.069536:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177075.069545:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177075.069547:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177075.069551:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069554:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145688448:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177075.069567:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145688960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177075.069571:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145688576:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177075.069589:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177075.069594:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177075.069598:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177075.069602:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177075.069606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f0e00 x1872931145688576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177075.069611:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10809
00000100:00080000:0.0:1786177075.069622:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177075.069625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145688576/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177075.069632:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177075.069636:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786177075.069641:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177075.069642:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069648:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145688576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177075.069653:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145688704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177075.069663:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145689088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177075.069671:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177075.069681:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f3b80 x1872931145688704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177075.069690:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145688704/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177075.069695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177075.069697:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069700:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145688704:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177075.069705:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145688832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177075.069715:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177075.069725:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f0a80 x1872931145688832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177075.069751:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145688832/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177075.069759:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177075.069762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069765:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145688832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177075.069781:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145688960:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177075.069797:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177075.069805:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f2a00 x1872931145688960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177075.069812:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145688960/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177075.069818:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177075.069822:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069825:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145688960:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177075.069831:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145689088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177075.069849:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177075.069861:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177075/real 1786177075]  req@ffff89d9870f1180 x1872931145689088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177075.069874:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145689088/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177075.069881:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177075.069883:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177075.069885:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145689088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177075.580979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177075.581041:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177076.093000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177076.605006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786177076.605044:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177077.116981:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177077.628978:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177077.629057:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177078.140999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177078.652971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177078.653047:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177079.165053:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786177079.677068:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177079.677105:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:3.0:1786177080.188995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786177080.189013:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177080.189019:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786177080.189022:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189030:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189038:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177080.189044:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177080.189076:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145689216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177080.189098:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177080.189101:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177080.189102:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189105:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189107:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177080.189110:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177080.189117:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177080.189125:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145689344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177080.189134:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177080.189137:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145689216:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786177080.189137:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177080.189141:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189148:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189150:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177080.189152:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177080.189156:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177080.189165:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145689472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177080.189171:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177080.189174:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177080.189175:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189177:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189192:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177080.189195:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177080.189198:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177080.189204:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145689600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177080.189210:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177080.189212:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177080.189214:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189216:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189218:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177080.189221:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177080.189223:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177080.189231:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145689728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177080.189234:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177080.189242:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177080.189245:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177080.189246:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189251:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189263:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177080.189265:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177080.189268:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177080.189278:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145689856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177080.189284:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2ffb80 x1872931145689216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177080.189287:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177080.189295:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177080.189299:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189306:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189310:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177080.189315:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145689216/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177080.189315:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177080.189318:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177080.189327:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145689984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177080.189336:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189345:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177080.189351:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177080.189352:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145689216:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786177080.189358:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177080.189361:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189365:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189367:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177080.189369:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177080.189372:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177080.189379:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145689344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177080.189380:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145690112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177080.189391:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177080.189393:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177080.189395:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177080.189398:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10814
00000100:00080000:1.0:1786177080.189401:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786177080.189405:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177080.189409:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177080.189414:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177080.189422:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2fd500 x1872931145689344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177080.189426:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145690240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177080.189448:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145689344/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177080.189455:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189465:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177080.189467:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145689344:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177080.189473:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145689472:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177080.189487:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177080.189494:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2fc700 x1872931145689472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177080.189502:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145689472/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177080.189508:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189509:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177080.189511:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145689472:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177080.189515:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145689600:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177080.189526:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177080.189532:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2fce00 x1872931145689600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177080.189539:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145689600/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177080.189544:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189546:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177080.189548:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145689600:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177080.189551:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145689728:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177080.189561:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177080.189566:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2fd880 x1872931145689728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177080.189574:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145689728/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177080.189579:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189581:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177080.189583:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145689728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177080.189586:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145689856:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177080.189595:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177080.189600:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2fe680 x1872931145689856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177080.189607:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145689856/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177080.189614:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189617:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177080.189620:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145689856:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177080.189626:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145689984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177080.189645:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177080.189657:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2fe300 x1872931145689984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177080.189670:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145689984/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177080.189699:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177080.189706:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145689984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177080.189722:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145690112:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177080.189738:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177080.189746:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2fdc00 x1872931145690112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177080.189761:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145690112/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177080.189767:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189769:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177080.189771:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145690112:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177080.189775:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145690240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177080.189786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177080.189792:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177080/real 1786177080]  req@ffff89d9ba2ff480 x1872931145690240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177080.189799:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145690240/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177080.189804:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177080.189806:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177080.189809:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145690240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177080.700981:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177080.701068:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177081.213008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177081.725011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177081.725138:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177082.237012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177082.749031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177082.749091:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177083.261005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177083.772994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177083.773070:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177084.284960:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177084.797019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177084.797095:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786177085.309026:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177085.309045:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786177085.309049:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177085.309059:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00080000:1.0:1786177085.309068:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177085.309075:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786177085.309075:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177085.309114:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145690368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177085.309134:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177085.309137:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177085.309138:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177085.309141:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00080000:1.0:1786177085.309145:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177085.309149:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177085.309160:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177085.309173:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145690368:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177085.309180:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145690496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177085.309197:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177085.309210:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177085.309212:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177085.309217:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00080000:1.0:1786177085.309222:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177085.309226:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177085.309231:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786177085.309233:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177085.309247:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145690624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177085.309256:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177085.309259:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177085.309261:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177085.309265:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00080000:1.0:1786177085.309267:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177085.309271:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177085.309275:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177085.309278:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2ff480 x1872931145690368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177085.309286:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145690752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177085.309297:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177085.309301:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145690368/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177085.309302:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177085.309306:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177085.309313:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00080000:1.0:1786177085.309318:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177085.309320:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177085.309322:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786177085.309327:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786177085.309328:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177085.309335:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145690368:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177085.309343:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145690880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177085.309355:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177085.309359:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786177085.309363:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145690496:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177085.309363:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177085.309374:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00080000:1.0:1786177085.309389:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786177085.309398:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177085.309400:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177085.309409:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177085.309412:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2fdc00 x1872931145690496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177085.309428:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145690496/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177085.309434:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786177085.309435:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145691008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177085.309442:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177085.309451:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145690496:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177085.309453:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177085.309458:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:0.0:1786177085.309459:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145690624:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177085.309462:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177085.309468:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00080000:1.0:1786177085.309472:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177085.309476:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:0.0:1786177085.309480:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786177085.309482:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177085.309492:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2fe300 x1872931145690624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177085.309498:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145691136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177085.309510:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145690624/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177085.309514:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177085.309523:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177085.309526:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177085.309527:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177085.309532:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177085.309539:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00100000:0.0:1786177085.309540:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145690624:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177085.309548:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177085.309552:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145690752:192.168.202.130@tcp:8:kworker.0
00000100:00080000:1.0:1786177085.309558:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177085.309566:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177085.309572:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177085.309585:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145691264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177085.309589:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2fe680 x1872931145690752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177085.309614:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177085.309618:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145690752/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177085.309619:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177085.309624:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177085.309647:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10819
00000100:00080000:0.0:1786177085.309648:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177085.309655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177085.309655:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177085.309664:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177085.309665:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145690752:192.168.202.130@tcp:8:kworker.0
00000008:00100000:1.0:1786177085.309672:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177085.309676:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145690880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177085.309687:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145691392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177085.309705:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177085.309729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2fd880 x1872931145690880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177085.309743:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145690880/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177085.309749:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177085.309751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177085.309754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145690880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177085.309767:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145691008:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177085.309783:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177085.309790:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2fce00 x1872931145691008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177085.309798:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145691008/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177085.309803:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177085.309805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177085.309807:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145691008:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177085.309810:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145691136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177085.309820:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177085.309826:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2fc700 x1872931145691136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177085.309838:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145691136/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177085.309843:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177085.309845:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177085.309846:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145691136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177085.309850:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145691264:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177085.309859:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177085.309864:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2fd500 x1872931145691264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177085.309871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145691264/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177085.309876:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177085.309878:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177085.309880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145691264:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177085.309883:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145691392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177085.309892:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177085.309920:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177085/real 1786177085]  req@ffff89d9ba2ffb80 x1872931145691392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177085.309930:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145691392/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177085.309941:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177085.309943:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177085.309945:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145691392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177085.821001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177085.821054:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177086.332986:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177086.845024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177086.845100:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177087.356990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177087.869011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177087.869074:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177088.380982:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177088.893020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177088.893106:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177089.404990:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177089.917017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177089.917091:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786177090.428995:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429003:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786177090.429007:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177090.429009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786177090.429017:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00080000:1.0:1786177090.429025:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177090.429031:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177090.429066:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145691520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177090.429087:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429089:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177090.429091:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177090.429094:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00080000:1.0:1786177090.429096:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177090.429099:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177090.429106:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177090.429118:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145691520:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177090.429118:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145691648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177090.429136:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429139:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177090.429140:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177090.429143:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00080000:1.0:1786177090.429146:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177090.429148:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177090.429152:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177090.429161:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145691776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177090.429167:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429170:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177090.429171:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177090.429173:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00080000:1.0:1786177090.429176:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786177090.429179:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177090.429183:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177090.429188:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177090.429197:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145691904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177090.429203:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429206:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177090.429207:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177090.429210:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00080000:1.0:1786177090.429213:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177090.429216:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177090.429220:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177090.429223:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2fc380 x1872931145691520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177090.429229:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145692032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177090.429255:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429257:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177090.429259:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177090.429262:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00080000:1.0:1786177090.429265:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177090.429270:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145691520/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177090.429271:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177090.429276:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177090.429286:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145692160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177090.429291:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177090.429294:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429298:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177090.429299:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177090.429300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177090.429309:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00100000:0.0:1786177090.429310:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145691520:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786177090.429312:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177090.429318:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177090.429322:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177090.429329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145692288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177090.429340:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145691648:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177090.429342:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429348:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177090.429350:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177090.429353:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00080000:1.0:1786177090.429355:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177090.429359:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177090.429364:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177090.429369:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177090.429381:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2ff800 x1872931145691648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177090.429388:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145692416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177090.429403:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145691648/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177090.429404:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177090.429415:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177090.429418:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177090.429426:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10824
00000100:00080000:0.0:1786177090.429429:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177090.429430:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177090.429437:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:0.0:1786177090.429440:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786177090.429443:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177090.429448:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145691648:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177090.429456:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145692544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177090.429461:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145691776:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177090.429491:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177090.429505:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2fdf80 x1872931145691776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177090.429519:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145691776/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177090.429528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177090.429530:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177090.429532:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145691776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177090.429537:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145691904:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177090.429551:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177090.429558:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2fea00 x1872931145691904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177090.429566:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145691904/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177090.429572:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177090.429574:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177090.429576:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145691904:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177090.429579:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145692032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177090.429609:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177090.429617:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2fed80 x1872931145692032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177090.429625:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145692032/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177090.429631:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177090.429633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177090.429635:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145692032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177090.429639:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145692160:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177090.429650:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177090.429655:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2fd180 x1872931145692160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177090.429663:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145692160/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177090.429668:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177090.429669:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177090.429672:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145692160:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177090.429686:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145692288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177090.429696:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177090.429703:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2ff100 x1872931145692288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177090.429710:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145692288/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177090.429719:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177090.429722:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177090.429725:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145692288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177090.429731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145692416:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177090.429750:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177090.429762:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2fc380 x1872931145692416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177090.429775:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145692416/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177090.429781:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177090.429783:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177090.429785:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145692416:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177090.429789:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145692544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177090.429803:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177090.429811:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177090/real 1786177090]  req@ffff89d9ba2ffb80 x1872931145692544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177090.429828:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145692544/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177090.429833:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177090.429835:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177090.429837:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145692544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177090.941075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177090.941244:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177091.453018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177091.965026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177091.965139:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177092.477006:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177092.989005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177092.989106:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177093.501066:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177094.013031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177094.013093:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177094.525024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177095.036983:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177095.037099:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177095.549015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177095.549040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177095.549048:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177095.549053:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177095.549064:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10829
00000100:00080000:0.0:1786177095.549073:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177095.549080:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177095.549116:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145692672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177095.549139:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177095.549143:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177095.549145:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177095.549150:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10829
00000100:00080000:0.0:1786177095.549156:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177095.549162:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177095.549172:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177095.549178:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145692672:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177095.549190:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145692800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177095.549205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177095.549208:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177095.549210:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177095.549215:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10829
00000100:00080000:0.0:1786177095.549236:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177095.549240:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177095.549247:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177095.549247:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177095.549265:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145692928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177095.549274:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177095.549278:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177095.549280:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177095.549285:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10829
00000100:00080000:0.0:1786177095.549290:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177095.549294:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f3100 x1872931145692672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177095.549299:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177095.549311:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177095.549321:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145692672/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177095.549328:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145693056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177095.549338:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177095.549344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177095.549347:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177095.549353:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786177095.549358:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145692672:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177095.549359:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177095.549370:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10829
00000100:00080000:0.0:1786177095.549376:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177095.549380:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177095.549386:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177095.549389:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145692800:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177095.549405:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145693184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177095.549418:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177095.549419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177095.549425:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177095.549428:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177095.549434:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10829
00000100:00080000:0.0:1786177095.549439:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177095.549439:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f0700 x1872931145692800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177095.549448:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177095.549458:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177095.549464:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145692800/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177095.549475:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145693312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177095.549476:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177095.549483:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177095.549492:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145692800:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177095.549499:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177095.549504:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145692928:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177095.549506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177095.549512:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177095.549518:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10829
00000100:00080000:0.0:1786177095.549525:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177095.549530:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177095.549551:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177095.549557:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177095.549572:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145693440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177095.549581:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f2d80 x1872931145692928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177095.549587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177095.549598:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177095.549602:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177095.549607:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145692928/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177095.549611:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10829
00000100:00080000:0.0:1786177095.549621:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177095.549631:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177095.549636:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786177095.549640:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177095.549643:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177095.549650:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145692928:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177095.549659:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145693568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177095.549660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145693056:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177095.549678:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177095.549682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177095.549685:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177095.549691:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10829
00000800:00000100:1.0:1786177095.549693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177095.549697:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177095.549704:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177095.549711:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177095.549711:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f1180 x1872931145693056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177095.549729:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145693696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177095.549732:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145693056/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177095.549761:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177095.549767:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177095.549772:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145693056:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177095.549792:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145693184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177095.549819:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177095.549831:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f2a00 x1872931145693184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177095.549843:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145693184/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177095.549851:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177095.549854:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177095.549858:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145693184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177095.549864:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145693312:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177095.549880:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177095.549890:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f0a80 x1872931145693312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177095.549925:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145693312/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177095.549933:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177095.549936:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177095.549939:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145693312:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177095.549944:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145693440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177095.549963:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177095.549974:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f3b80 x1872931145693440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177095.549986:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145693440/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177095.549994:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177095.549997:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177095.549999:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145693440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177095.550005:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145693568:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177095.550021:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177095.550031:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f0e00 x1872931145693568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177095.550042:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145693568/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177095.550050:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177095.550053:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177095.550056:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145693568:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177095.550062:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145693696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177095.550077:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177095.550087:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177095/real 1786177095]  req@ffff89d9870f1500 x1872931145693696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177095.550097:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145693696/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177095.550105:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177095.550108:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177095.550112:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145693696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177096.061011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177096.061069:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177096.573010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177097.084979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177097.085071:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177097.596998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177098.109006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177098.109080:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177098.620960:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177099.132990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177099.133063:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177099.644992:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177100.156969:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177100.157112:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177100.668983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177100.669000:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177100.669007:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177100.669012:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177100.669023:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00080000:0.0:1786177100.669033:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177100.669042:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177100.669082:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145693824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177100.669112:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177100.669116:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177100.669118:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177100.669122:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00080000:0.0:1786177100.669127:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177100.669131:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177100.669141:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177100.669159:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145693952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177100.669170:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177100.669174:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177100.669177:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177100.669182:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00080000:0.0:1786177100.669186:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177100.669194:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177100.669195:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145693824:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786177100.669203:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177100.669220:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145694080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177100.669232:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177100.669236:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177100.669238:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177100.669242:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00080000:0.0:1786177100.669247:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177100.669251:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177100.669256:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786177100.669257:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177100.669273:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145694208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177100.669284:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177100.669288:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177100.669291:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177100.669293:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f3480 x1872931145693824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177100.669298:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00080000:0.0:1786177100.669307:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177100.669314:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145693824/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177100.669315:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177100.669325:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177100.669329:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669334:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177100.669338:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145693824:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177100.669343:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145694336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177100.669347:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145693952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177100.669362:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177100.669367:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:1.0:1786177100.669369:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177100.669371:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177100.669378:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00100000:1.0:1786177100.669383:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f2680 x1872931145693952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177100.669385:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177100.669395:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177100.669405:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177100.669410:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145693952/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177100.669420:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145694464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177100.669425:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669435:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177100.669442:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177100.669443:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145693952:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177100.669450:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177100.669454:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177100.669459:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00080000:0.0:1786177100.669464:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177100.669468:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177100.669474:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177100.669476:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145694080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177100.669502:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145694592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177100.669515:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177100.669519:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177100.669523:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177100.669527:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177100.669534:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00100000:1.0:1786177100.669535:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f1880 x1872931145694080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177100.669541:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177100.669550:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177100.669550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145694080/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177100.669559:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177100.669566:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669572:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177100.669577:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145694720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177100.669579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145694080:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177100.669594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145694208:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177100.669597:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177100.669603:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177100.669606:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177100.669612:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10834
00000100:00080000:0.0:1786177100.669619:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177100.669623:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177100.669627:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177100.669635:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177100.669638:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f1500 x1872931145694208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177100.669654:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145694848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177100.669654:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145694208/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177100.669674:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669680:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177100.669684:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145694208:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177100.669689:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145694336:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177100.669703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177100.669709:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f0e00 x1872931145694336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177100.669716:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145694336/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177100.669721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669723:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177100.669725:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145694336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177100.669728:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145694464:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177100.669737:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177100.669743:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f3b80 x1872931145694464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177100.669750:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145694464/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177100.669755:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669757:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177100.669759:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145694464:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177100.669770:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145694592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177100.669779:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177100.669786:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f0a80 x1872931145694592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177100.669793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145694592/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177100.669798:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669800:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177100.669801:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145694592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177100.669805:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145694720:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177100.669814:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177100.669820:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f2a00 x1872931145694720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177100.669827:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145694720/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177100.669837:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669838:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177100.669840:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145694720:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177100.669843:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145694848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177100.669858:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177100.669864:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177100/real 1786177100]  req@ffff89d9870f1180 x1872931145694848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177100.669872:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145694848/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177100.669877:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177100.669879:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177100.669880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145694848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177101.180991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177101.181094:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177101.693002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177102.205007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177102.205059:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177102.717033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786177103.229042:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177103.229086:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:0.0:1786177103.740991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177104.253006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177104.253067:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177104.765015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177105.276986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177105.277096:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177105.788966:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786177105.788985:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177105.788990:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786177105.788994:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177105.789002:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00080000:1.0:1786177105.789010:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177105.789016:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177105.789048:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145694976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177105.789070:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177105.789073:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177105.789074:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177105.789079:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00080000:1.0:1786177105.789083:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177105.789087:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177105.789097:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145694976:192.168.202.130@tcp:250:kworker.0
00000008:00100000:1.0:1786177105.789098:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177105.789125:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145695104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177105.789137:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177105.789140:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177105.789142:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177105.789145:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00080000:1.0:1786177105.789149:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786177105.789153:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177105.789157:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177105.789162:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177105.789171:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145695232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177105.789177:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177105.789180:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177105.789182:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177105.789184:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00080000:1.0:1786177105.789187:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177105.789190:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177105.789194:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177105.789201:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145695360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177105.789207:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177105.789210:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177105.789212:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177105.789217:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00100000:0.0:1786177105.789218:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2fd500 x1872931145694976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177105.789219:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177105.789226:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177105.789232:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177105.789242:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145695488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177105.789245:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145694976/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177105.789259:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177105.789265:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177105.789266:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177105.789267:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177105.789271:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00080000:0.0:1786177105.789274:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177105.789279:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177105.789280:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145694976:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786177105.789289:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177105.789295:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177105.789308:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145695616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177105.789314:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145695104:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177105.789332:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786177105.789334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177105.789338:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177105.789341:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177105.789345:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00100000:0.0:1786177105.789349:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2fc700 x1872931145695104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177105.789350:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177105.789358:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177105.789364:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177105.789369:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145695104/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177105.789377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1786177105.789378:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145695744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177105.789384:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177105.789392:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145695104:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177105.789394:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177105.789398:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1786177105.789401:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145695232:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177105.789401:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177105.789406:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00080000:1.0:1786177105.789409:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177105.789412:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177105.789416:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1786177105.789421:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177105.789425:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145695872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177105.789432:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2fce00 x1872931145695232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177105.789458:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177105.789461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145695232/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177105.789463:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177105.789466:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177105.789474:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10840
00000100:00080000:1.0:1786177105.789480:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177105.789486:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177105.789486:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177105.789491:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1786177105.789492:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177105.789498:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145695232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177105.789507:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145696000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177105.789508:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145695360:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177105.789534:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177105.789550:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2fd880 x1872931145695360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177105.789563:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145695360/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177105.789572:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177105.789575:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177105.789579:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145695360:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177105.789586:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145695488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177105.789604:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177105.789612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2fe680 x1872931145695488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177105.789620:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145695488/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177105.789625:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177105.789627:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177105.789630:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145695488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177105.789642:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145695616:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177105.789653:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177105.789659:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2fe300 x1872931145695616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177105.789667:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145695616/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177105.789672:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177105.789673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177105.789675:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145695616:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177105.789678:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145695744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177105.789687:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177105.789693:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2fdc00 x1872931145695744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177105.789700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145695744/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177105.789705:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177105.789707:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177105.789709:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145695744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177105.789712:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145695872:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177105.789721:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177105.789727:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2ff480 x1872931145695872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177105.789734:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145695872/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177105.789739:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177105.789741:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177105.789742:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145695872:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177105.789745:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145696000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177105.789754:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177105.789759:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177105/real 1786177105]  req@ffff89d9ba2fd500 x1872931145696000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177105.789767:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145696000/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177105.789771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177105.789773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177105.789775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145696000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177106.301026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177106.303204:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177106.813057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177107.324971:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177107.325060:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177107.836976:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177108.349012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177108.349068:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177108.861017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177109.373068:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177109.373110:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177109.884999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177110.397007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177110.397077:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177110.909034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177110.909039:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177110.909045:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177110.909049:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177110.909058:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909067:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177110.909074:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177110.909107:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145696128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177110.909136:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177110.909140:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177110.909142:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177110.909148:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909153:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177110.909158:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177110.909168:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177110.909186:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145696128:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177110.909186:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145696256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177110.909201:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177110.909203:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177110.909205:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177110.909209:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909212:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177110.909215:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177110.909220:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177110.909230:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145696384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177110.909242:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786177110.909244:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177110.909246:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177110.909248:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177110.909251:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909255:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177110.909257:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177110.909261:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177110.909269:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145696512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177110.909275:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177110.909278:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177110.909279:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177110.909281:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909284:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177110.909286:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177110.909290:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87ed80 x1872931145696128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177110.909291:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177110.909303:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145696640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177110.909311:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177110.909312:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145696128/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177110.909319:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177110.909323:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177110.909331:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177110.909331:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909336:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177110.909338:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177110.909342:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177110.909346:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145696128:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786177110.909348:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177110.909358:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145696768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177110.909365:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177110.909368:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145696256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177110.909369:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177110.909373:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177110.909377:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909379:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177110.909382:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177110.909399:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177110.909409:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145696896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177110.909415:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1786177110.909420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177110.909420:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177110.909422:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177110.909427:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909431:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177110.909436:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87c700 x1872931145696256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177110.909436:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177110.909443:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177110.909453:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145696256/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177110.909461:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786177110.909463:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145697024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177110.909466:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177110.909475:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145696256:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177110.909488:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177110.909489:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145696384:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177110.909491:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177110.909494:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177110.909501:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10845
00000100:00080000:2.0:1786177110.909503:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177110.909506:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177110.909509:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177110.909517:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145697152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177110.909526:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177110.909543:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87c380 x1872931145696384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177110.909556:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145696384/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177110.909570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177110.909573:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177110.909577:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145696384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177110.909583:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145696512:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177110.909601:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177110.909612:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87ca80 x1872931145696512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177110.909624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145696512/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177110.909632:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177110.909635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177110.909639:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145696512:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177110.909645:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145696640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177110.909664:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177110.909676:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87dc00 x1872931145696640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177110.909689:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145696640/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177110.909697:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177110.909700:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177110.909704:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145696640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177110.909723:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145696768:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177110.909743:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177110.909755:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87e680 x1872931145696768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177110.909768:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145696768/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177110.909782:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177110.909786:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177110.909790:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145696768:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177110.909796:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145696896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177110.909824:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177110.909837:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87d880 x1872931145696896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177110.909849:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145696896/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177110.909857:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177110.909861:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177110.909864:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145696896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177110.909871:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145697024:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177110.909890:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177110.909944:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87f800 x1872931145697024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177110.909955:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145697024/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177110.909963:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177110.909966:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177110.909970:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145697024:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177110.909976:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145697152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177110.909996:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177110.910009:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177110/real 1786177110]  req@ffff89d99e87df80 x1872931145697152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177110.910022:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145697152/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177110.910030:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177110.910034:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177110.910037:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145697152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177111.420994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177111.421079:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177111.933005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177112.444987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177112.445130:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177112.957026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177113.469041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177113.469116:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177113.981030:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177114.492969:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177114.493076:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177115.005051:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177115.517049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177115.517107:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177116.028956:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177116.029006:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177116.029016:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177116.029021:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177116.029032:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10850
00000100:00080000:2.0:1786177116.029042:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177116.029050:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177116.029097:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145697280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177116.029125:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177116.029128:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177116.029130:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177116.029133:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10850
00000100:00080000:2.0:1786177116.029135:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177116.029138:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177116.029151:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177116.029162:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145697408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177116.029171:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145697280:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177116.029180:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177116.029183:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177116.029185:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177116.029189:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10850
00000100:00080000:2.0:1786177116.029191:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177116.029195:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177116.029199:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177116.029210:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145697536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177116.029218:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177116.029221:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177116.029222:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177116.029226:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10850
00000100:00080000:2.0:1786177116.029228:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177116.029231:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177116.029234:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177116.029243:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145697664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177116.029250:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177116.029253:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177116.029256:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177116.029261:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10850
00000800:00000100:0.0:1786177116.029270:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177116.029273:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177116.029281:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177116.029289:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177116.029305:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145697792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177116.029316:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177116.029319:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177116.029320:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177116.029324:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10850
00000100:00080000:2.0:1786177116.029330:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177116.029334:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87d500 x1872931145697280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177116.029356:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177116.029372:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177116.029386:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145697280/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.029397:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177116.029401:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177116.029404:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145697280:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177116.029416:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145697920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177116.029432:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177116.029437:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145697408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177116.029437:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177116.029442:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177116.029452:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10850
00000100:00080000:2.0:1786177116.029456:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177116.029459:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177116.029463:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177116.029475:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145698048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177116.029482:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177116.029485:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177116.029490:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1786177116.029494:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177116.029500:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10850
00000100:00080000:2.0:1786177116.029506:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177116.029509:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177116.029515:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177116.029524:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87c000 x1872931145697408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177116.029533:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145698176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177116.029541:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145697408/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.029603:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177116.029614:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177116.029623:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177116.029624:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177116.029629:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1786177116.029637:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145697408:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177116.029642:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10850
00000100:00080000:2.0:1786177116.029652:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1786177116.029660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145697536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177116.029663:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177116.029672:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177116.029692:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145698304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177116.029709:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177116.029726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87f100 x1872931145697536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177116.029741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145697536/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.029747:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177116.029750:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177116.029752:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145697536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177116.029757:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145697664:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177116.029780:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177116.029787:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87df80 x1872931145697664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177116.029795:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145697664/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.029800:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177116.029803:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177116.029805:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145697664:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177116.029809:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145697792:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177116.029819:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177116.029825:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87f800 x1872931145697792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177116.029832:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145697792/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.029841:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177116.029843:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177116.029845:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145697792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177116.029859:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145697920:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177116.029869:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177116.029875:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87d880 x1872931145697920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177116.029882:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145697920/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.029887:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177116.029889:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177116.029891:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145697920:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177116.029895:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145698048:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177116.029926:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177116.029934:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87e680 x1872931145698048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177116.029941:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145698048/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.029946:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177116.029948:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177116.029951:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145698048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177116.029955:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145698176:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177116.029966:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177116.029971:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87dc00 x1872931145698176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177116.029989:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145698176/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.029998:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177116.030002:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177116.030006:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145698176:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177116.030013:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145698304:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177116.030047:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177116.030059:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177116/real 1786177116]  req@ffff89d99e87ca80 x1872931145698304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177116.030072:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145698304/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177116.030080:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177116.030083:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177116.030087:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145698304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177116.541044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177116.541111:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177117.053010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177117.565007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177117.565135:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177118.077010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177118.589029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177118.589083:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177119.101015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177119.613024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177119.613125:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177120.125058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177120.636977:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177120.637079:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177121.149003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177121.149029:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177121.149034:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177121.149039:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177121.149048:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00080000:2.0:1786177121.149057:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149064:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177121.149095:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145698432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177121.149118:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177121.149122:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177121.149123:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177121.149126:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00080000:2.0:1786177121.149129:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149131:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177121.149140:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177121.149154:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145698560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177121.149168:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177121.149171:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145698432:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177121.149173:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177121.149178:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177121.149186:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00080000:2.0:1786177121.149197:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149202:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177121.149210:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177121.149225:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145698688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177121.149242:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177121.149246:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177121.149247:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177121.149251:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00080000:2.0:1786177121.149255:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149259:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177121.149266:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177121.149278:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145698560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177121.149282:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145698816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177121.149313:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177121.149318:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177121.149320:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177121.149325:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00100000:1.0:1786177121.149329:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145698688:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177121.149331:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149338:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177121.149345:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177121.149362:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145698944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177121.149372:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177121.149375:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177121.149377:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177121.149380:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00080000:2.0:1786177121.149386:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149390:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177121.149396:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177121.149400:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145698816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177121.149414:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145699072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177121.149427:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177121.149431:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177121.149435:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177121.149436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145698944:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177121.149446:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00080000:2.0:1786177121.149451:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149456:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177121.149462:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177121.149469:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145699072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177121.149478:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145699200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177121.149508:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177121.149513:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177121.149516:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177121.149522:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00080000:2.0:1786177121.149526:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149531:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177121.149536:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177121.149546:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145699328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177121.149562:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177121.149565:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177121.149567:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177121.149571:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10855
00000100:00080000:2.0:1786177121.149574:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177121.149577:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177121.149582:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177121.149592:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145699456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177121.149615:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145699200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177121.149650:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145699328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177121.149670:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145699456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177121.660986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177121.661054:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177122.173061:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177122.685013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177122.685077:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177123.197039:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177123.709031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177123.709107:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177124.221153:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786177124.221279:0:2380:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786177124.221319:0:2380:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786177124.221336:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786177124.221400:0:2380:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786177124.221419:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786177124.221425:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87c380 x1872931145698432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786177124.221435:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786177124.221448:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786177124.221464:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145698432/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786177124.221464:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786177124.221479:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:0.0:1786177124.221484:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221494:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000800:00000100:2.0:1786177124.221494:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786177124.221504:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145698432:192.168.202.130@tcp:250:kworker.0
00000800:00000100:2.0:1786177124.221511:0:2380:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:0.0:1786177124.221532:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87d880 x1872931145699200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177124.221550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145699200/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177124.221559:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221564:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177124.221568:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145699200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177124.221576:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87f800 x1872931145699328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177124.221590:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145699328/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177124.221599:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221603:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177124.221607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145699328:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177124.221616:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87df80 x1872931145699456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177124.221627:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145699456/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177124.221636:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221640:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177124.221643:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145699456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177124.221649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87e680 x1872931145699072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177124.221661:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145699072/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177124.221670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221673:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177124.221676:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145699072:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177124.221683:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87ca80 x1872931145698816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177124.221694:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145698816/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177124.221701:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177124.221707:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145698816:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177124.221713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87dc00 x1872931145698944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177124.221724:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145698944/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177124.221737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221740:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177124.221743:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145698944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177124.221750:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87c700 x1872931145698560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177124.221762:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145698560/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177124.221771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177124.221778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145698560:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177124.221785:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177121/real 1786177124]  req@ffff89d99e87ed80 x1872931145698688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177124.221798:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145698688/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177124.221805:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177124.221808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177124.221812:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145698688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786177124.733000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177124.733095:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177125.245031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177125.757046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177125.757124:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786177126.269014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177126.269026:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177126.269031:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177126.269042:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00080000:2.0:1786177126.269053:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177126.269059:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177126.269095:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145699584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177126.269124:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177126.269130:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1786177126.269131:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177126.269133:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177126.269139:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00080000:2.0:1786177126.269144:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177126.269148:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177126.269158:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177126.269169:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145699712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177126.269179:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177126.269182:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177126.269184:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177126.269187:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145699584:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177126.269188:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00080000:2.0:1786177126.269195:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177126.269202:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177126.269207:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177126.269221:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145699840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177126.269232:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177126.269253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177126.269255:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177126.269260:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00080000:2.0:1786177126.269265:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177126.269269:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177126.269275:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786177126.269278:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177126.269296:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145699968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177126.269308:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177126.269311:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177126.269314:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177126.269318:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00080000:2.0:1786177126.269323:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177126.269333:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177126.269339:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87f100 x1872931145699584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177126.269341:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177126.269361:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145700096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177126.269369:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145699584/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177126.269376:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177126.269385:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177126.269387:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177126.269388:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177126.269395:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00080000:1.0:1786177126.269397:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177126.269404:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177126.269405:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145699584:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177126.269426:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177126.269433:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177126.269434:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145699712:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177126.269454:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145700224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177126.269469:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177126.269471:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177126.269476:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177126.269479:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177126.269485:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00100000:1.0:1786177126.269490:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87c000 x1872931145699712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177126.269493:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177126.269503:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177126.269514:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177126.269515:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145699712/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177126.269528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786177126.269529:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145700352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177126.269537:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177126.269545:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145699712:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177126.269551:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177126.269555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177126.269557:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177126.269562:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00080000:2.0:1786177126.269566:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177126.269570:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177126.269574:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145699840:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786177126.269578:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177126.269594:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145700480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177126.269603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177126.269605:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177126.269611:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177126.269613:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177126.269620:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10860
00000100:00080000:2.0:1786177126.269624:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177126.269631:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87d500 x1872931145699840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177126.269631:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177126.269641:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177126.269651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145699840/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177126.269658:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145700608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177126.269667:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177126.269676:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177126.269681:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145699840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177126.269689:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145699968:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177126.269710:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177126.269722:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87ed80 x1872931145699968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177126.269735:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145699968/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177126.269743:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177126.269746:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177126.269749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145699968:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177126.269755:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145700096:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177126.269779:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177126.269789:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87c700 x1872931145700096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177126.269800:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145700096/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177126.269808:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177126.269811:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177126.269814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145700096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177126.269832:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145700224:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177126.269849:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177126.269860:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87dc00 x1872931145700224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177126.269872:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145700224/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177126.269881:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177126.269884:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177126.269887:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145700224:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177126.269893:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145700352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177126.269955:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177126.269969:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87ca80 x1872931145700352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177126.269983:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145700352/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177126.269992:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177126.269995:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177126.269999:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145700352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177126.270006:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145700480:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177126.270025:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177126.270037:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87e680 x1872931145700480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177126.270049:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145700480/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177126.270064:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177126.270068:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177126.270071:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145700480:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177126.270077:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145700608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177126.270098:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177126.270110:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177126/real 1786177126]  req@ffff89d99e87df80 x1872931145700608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177126.270123:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145700608/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177126.270131:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177126.270134:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177126.270137:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145700608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177126.780976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177126.781075:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177127.293094:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177127.804976:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177127.805042:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177128.317005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177128.829010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177128.829076:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177129.340991:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177129.853007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177129.853122:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177130.365015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177130.877020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177130.877081:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786177131.389005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177131.389010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177131.389016:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177131.389021:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177131.389031:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00080000:0.0:1786177131.389041:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177131.389048:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177131.389090:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145700736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177131.389111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177131.389115:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177131.389117:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177131.389121:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00080000:0.0:1786177131.389124:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177131.389129:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177131.389139:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177131.389146:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145700736:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177131.389151:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145700864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177131.389160:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177131.389163:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177131.389165:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177131.389168:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00080000:0.0:1786177131.389172:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177131.389175:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177131.389179:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177131.389220:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145700992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177131.389220:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177131.389234:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177131.389237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177131.389239:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177131.389243:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00080000:0.0:1786177131.389246:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177131.389249:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177131.389254:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177131.389267:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f2d80 x1872931145700736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177131.389272:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145701120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177131.389281:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177131.389285:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786177131.389286:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145700736/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177131.389287:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177131.389290:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00080000:0.0:1786177131.389294:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177131.389297:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177131.389297:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1786177131.389302:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177131.389302:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177131.389307:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145700736:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177131.389311:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145701248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177131.389321:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177131.389324:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177131.389325:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177131.389329:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00080000:0.0:1786177131.389332:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177131.389336:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177131.389339:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145700864:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786177131.389340:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177131.389349:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145701376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177131.389359:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177131.389361:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177131.389363:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177131.389364:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177131.389368:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00080000:0.0:1786177131.389371:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177131.389373:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f0700 x1872931145700864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177131.389375:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177131.389379:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177131.389387:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145700864/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177131.389388:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145701504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177131.389397:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177131.389398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177131.389401:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177131.389402:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177131.389403:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177131.389404:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145700864:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177131.389407:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00100000:1.0:1786177131.389410:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145700992:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177131.389411:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177131.389414:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177131.389419:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177131.389428:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145701632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177131.389428:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177131.389438:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f3100 x1872931145700992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177131.389445:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177131.389448:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177131.389450:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177131.389451:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145700992/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177131.389454:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10865
00000100:00080000:0.0:1786177131.389458:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177131.389459:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177131.389461:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177131.389463:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786177131.389466:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177131.389467:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145700992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177131.389472:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145701120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177131.389475:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145701760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177131.389490:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177131.389500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f1180 x1872931145701120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177131.389513:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145701120/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177131.389521:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177131.389525:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177131.389528:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145701120:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177131.389535:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145701248:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177131.389554:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177131.389570:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f2a00 x1872931145701248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177131.389579:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145701248/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177131.389585:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177131.389587:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177131.389589:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145701248:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177131.389601:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145701376:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177131.389614:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177131.389620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f0a80 x1872931145701376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177131.389628:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145701376/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177131.389633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177131.389635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177131.389636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145701376:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177131.389640:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145701504:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177131.389649:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177131.389663:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f3b80 x1872931145701504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177131.389671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145701504/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177131.389676:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177131.389678:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177131.389679:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145701504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177131.389683:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145701632:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177131.389693:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177131.389699:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f0e00 x1872931145701632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177131.389706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145701632/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177131.389711:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177131.389713:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177131.389715:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145701632:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177131.389719:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145701760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177131.389728:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177131.389733:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177131/real 1786177131]  req@ffff89d9870f1500 x1872931145701760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177131.389740:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145701760/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177131.389745:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177131.389747:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177131.389749:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145701760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177131.900984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177131.901077:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177132.413014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177132.925024:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177132.925098:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177133.436977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177133.948979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177133.949034:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177134.461019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177134.973005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177134.973071:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177135.485000:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177135.996992:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177135.997092:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786177136.509007:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177136.509007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177136.509018:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177136.509024:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177136.509034:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00080000:0.0:1786177136.509044:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509052:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177136.509100:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145701888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177136.509125:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177136.509128:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177136.509130:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177136.509133:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00080000:0.0:1786177136.509149:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509154:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177136.509165:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177136.509169:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145701888:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177136.509184:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145702016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177136.509194:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177136.509196:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177136.509198:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177136.509202:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00080000:0.0:1786177136.509205:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509208:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177136.509211:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177136.509221:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145702144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177136.509227:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177136.509230:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177136.509232:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177136.509234:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00080000:0.0:1786177136.509237:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509239:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177136.509242:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177136.509248:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177136.509252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145702272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177136.509260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177136.509263:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177136.509265:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177136.509267:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00080000:0.0:1786177136.509272:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509274:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177136.509277:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177136.509284:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145702400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177136.509290:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177136.509292:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177136.509294:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177136.509297:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00080000:0.0:1786177136.509299:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509302:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177136.509305:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177136.509311:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f1880 x1872931145701888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177136.509321:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145702528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177136.509329:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177136.509331:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177136.509332:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177136.509337:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00100000:1.0:1786177136.509339:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145701888/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177136.509340:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509348:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177136.509357:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177136.509362:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.509371:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.509379:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145701888:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177136.509380:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145702656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177136.509394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177136.509398:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177136.509400:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177136.509406:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00080000:0.0:1786177136.509410:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509415:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177136.509421:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177136.509423:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145702016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177136.509436:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145702784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177136.509448:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177136.509452:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177136.509455:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786177136.509459:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177136.509464:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10870
00000100:00080000:0.0:1786177136.509470:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177136.509474:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177136.509481:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f2680 x1872931145702016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177136.509487:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177136.509501:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145702016/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177136.509506:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145702912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177136.509525:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.509533:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.509539:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145702016:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177136.509547:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145702144:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177136.509583:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177136.509596:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f3480 x1872931145702144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177136.509610:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145702144/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177136.509620:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.509624:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.509628:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145702144:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177136.509634:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145702272:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177136.509657:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177136.509669:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f1500 x1872931145702272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177136.509682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145702272/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177136.509691:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.509694:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.509698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145702272:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177136.509705:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145702400:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177136.509725:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177136.509735:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f0e00 x1872931145702400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177136.509747:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145702400/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177136.509757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.509760:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.509763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145702400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177136.509769:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145702528:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177136.509786:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177136.509797:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f3b80 x1872931145702528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177136.509816:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145702528/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177136.509825:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.509827:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.509831:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145702528:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177136.509837:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145702656:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177136.509855:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177136.509865:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f0a80 x1872931145702656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177136.509879:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145702656/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177136.509886:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.509890:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.509893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145702656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177136.509935:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145702784:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177136.509954:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177136.509966:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f2a00 x1872931145702784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177136.509978:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145702784/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177136.509993:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.509997:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.510001:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145702784:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177136.510007:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145702912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177136.510026:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177136.510037:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177136/real 1786177136]  req@ffff89d9870f1180 x1872931145702912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177136.510049:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145702912/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177136.510058:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177136.510061:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177136.510064:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145702912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177137.021039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177137.021116:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177137.533014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177138.045027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177138.045135:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177138.557012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177139.069055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177139.069178:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177139.581007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177140.093001:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177140.093081:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177140.604978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177141.117031:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177141.117132:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177141.628983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177141.629003:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177141.629009:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177141.629013:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177141.629022:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00080000:3.0:1786177141.629032:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177141.629038:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177141.629070:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145703040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177141.629116:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177141.629120:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177141.629121:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177141.629127:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00100000:1.0:1786177141.629128:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145703040:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177141.629131:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177141.629137:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177141.629145:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177141.629157:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145703168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177141.629167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177141.629169:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177141.629171:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177141.629174:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00080000:3.0:1786177141.629177:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177141.629179:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177141.629182:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177141.629188:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786177141.629193:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145703296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177141.629201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177141.629204:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177141.629205:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177141.629208:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00080000:3.0:1786177141.629210:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177141.629212:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177141.629216:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177141.629229:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe67800 x1872931145703040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177141.629230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145703424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177141.629264:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177141.629268:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177141.629269:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177141.629272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145703040/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177141.629275:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00080000:3.0:1786177141.629280:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177141.629287:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177141.629293:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786177141.629293:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177141.629301:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786177141.629307:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145703552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177141.629308:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145703040:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177141.629321:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177141.629324:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177141.629325:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177141.629329:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00080000:3.0:1786177141.629331:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177141.629336:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145703168:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177141.629336:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177141.629344:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177141.629354:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145703680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177141.629363:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177141.629365:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177141.629368:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177141.629371:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177141.629375:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00080000:3.0:1786177141.629379:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177141.629382:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe67480 x1872931145703168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177141.629385:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177141.629392:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177141.629400:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145703168/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177141.629405:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145703808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177141.629417:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786177141.629420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177141.629424:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786177141.629426:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786177141.629430:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145703168:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177141.629430:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177141.629437:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00080000:3.0:1786177141.629440:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177141.629443:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145703296:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177141.629446:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177141.629452:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177141.629463:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145703936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177141.629471:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177141.629473:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177141.629477:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177141.629478:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177141.629483:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe66680 x1872931145703296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177141.629483:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10875
00000100:00080000:3.0:1786177141.629489:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177141.629495:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177141.629502:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177141.629506:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145703296/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177141.629513:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145704064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177141.629515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177141.629522:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177141.629531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145703296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177141.629538:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145703424:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177141.629551:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177141.629558:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe65880 x1872931145703424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177141.629565:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145703424/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177141.629570:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177141.629572:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177141.629574:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145703424:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177141.629577:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145703552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177141.629586:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177141.629592:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe64a80 x1872931145703552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177141.629599:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145703552/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177141.629604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177141.629605:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177141.629607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145703552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177141.629617:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145703680:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177141.629627:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177141.629633:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe66300 x1872931145703680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177141.629640:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145703680/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177141.629645:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177141.629647:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177141.629649:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145703680:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177141.629652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145703808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177141.629662:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177141.629667:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe65180 x1872931145703808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177141.629674:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145703808/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177141.629679:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177141.629681:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177141.629682:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145703808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177141.629686:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145703936:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177141.629695:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177141.629700:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe64000 x1872931145703936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177141.629706:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145703936/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177141.629716:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177141.629717:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177141.629719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145703936:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177141.629722:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145704064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177141.629731:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177141.629736:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177141/real 1786177141]  req@ffff89d99fe64380 x1872931145704064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177141.629743:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145704064/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177141.629748:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177141.629749:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177141.629751:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145704064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177142.140982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177142.141067:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177142.652983:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177143.165011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177143.165067:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177143.677005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177144.188986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177144.189038:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177144.700961:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177145.213027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177145.213096:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177145.725018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177146.236942:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177146.237085:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786177146.749062:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177146.749070:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177146.749075:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177146.749084:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177146.749095:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00080000:3.0:1786177146.749107:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177146.749115:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177146.749174:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145704192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177146.749200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177146.749203:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177146.749205:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177146.749218:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00080000:3.0:1786177146.749221:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177146.749226:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177146.749236:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145704192:192.168.202.130@tcp:250:kworker.0
00000008:00100000:3.0:1786177146.749238:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177146.749276:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145704320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177146.749287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177146.749289:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177146.749292:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177146.749298:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00080000:3.0:1786177146.749300:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177146.749303:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177146.749309:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177146.749317:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786177146.749323:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145704448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177146.749333:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177146.749337:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177146.749338:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177146.749341:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00080000:3.0:1786177146.749344:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177146.749347:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177146.749352:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177146.749363:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe67b80 x1872931145704192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177146.749367:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145704576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177146.749440:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177146.749450:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177146.749451:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177146.749458:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00080000:3.0:1786177146.749461:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177146.749466:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177146.749471:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145704192/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786177146.749472:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177146.749492:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177146.749496:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786177146.749501:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145704704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177146.749503:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145704192:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177146.749527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177146.749531:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177146.749533:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177146.749540:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145704320:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177146.749540:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00080000:3.0:1786177146.749552:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177146.749567:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177146.749573:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786177146.749573:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177146.749592:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145704832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177146.749603:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe67100 x1872931145704320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177146.749605:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177146.749613:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177146.749615:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177146.749630:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145704320/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177146.749644:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00080000:3.0:1786177146.749655:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177146.749656:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177146.749668:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177146.749671:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145704320:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177146.749678:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177146.749679:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145704448:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786177146.749691:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177146.749706:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145704960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177146.749713:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177146.749723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177146.749726:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe64700 x1872931145704448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177146.749727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177146.749733:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177146.749751:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00100000:1.0:1786177146.749759:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145704448/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177146.749759:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177146.749774:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177146.749792:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786177146.749792:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177146.749800:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177146.749803:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145704448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177146.749809:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145704576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177146.749819:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145705088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177146.749827:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177146.749838:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe66a00 x1872931145704576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177146.749839:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177146.749848:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177146.749853:0:37:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177146.749860:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10880
00000100:00080000:3.0:1786177146.749868:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177146.749874:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177146.749880:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145704576/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786177146.749880:0:37:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177146.749919:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177146.749926:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:3.0:1786177146.749927:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145705216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177146.749935:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145704576:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177146.749948:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145704704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177146.749981:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177146.749999:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe65500 x1872931145704704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177146.750009:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145704704/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177146.750015:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177146.750017:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177146.750020:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145704704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177146.750035:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145704832:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177146.750067:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177146.750076:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe66d80 x1872931145704832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177146.750083:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145704832/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177146.750088:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177146.750091:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177146.750093:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145704832:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177146.750096:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145704960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177146.750107:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177146.750113:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe65f80 x1872931145704960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177146.750120:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145704960/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177146.750125:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177146.750127:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177146.750129:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145704960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177146.750132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145705088:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177146.750141:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177146.750147:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe67b80 x1872931145705088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177146.750154:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145705088/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177146.750160:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177146.750161:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177146.750163:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145705088:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177146.750167:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145705216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177146.750177:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177146.750183:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177146/real 1786177146]  req@ffff89d99fe64380 x1872931145705216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177146.750190:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145705216/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177146.750195:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177146.750197:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177146.750198:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145705216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177147.261029:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177147.261103:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177147.773058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177148.285055:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177148.285177:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177148.797008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177149.309115:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177149.309183:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177149.821032:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177150.333075:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177150.333313:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177150.845031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177151.357011:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177151.357057:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177151.869023:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177151.869039:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177151.869046:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177151.869051:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177151.869061:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00080000:2.0:1786177151.869072:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177151.869080:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177151.869119:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145705344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177151.869148:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177151.869153:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177151.869155:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177151.869159:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00080000:2.0:1786177151.869164:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177151.869169:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177151.869179:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177151.869180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145705344:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177151.869199:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145705472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177151.869220:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177151.869225:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177151.869227:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177151.869232:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00080000:2.0:1786177151.869237:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177151.869242:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177151.869247:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177151.869249:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177151.869265:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145705600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177151.869277:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177151.869282:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177151.869284:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177151.869289:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87f800 x1872931145705344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177151.869290:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00080000:2.0:1786177151.869298:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177151.869305:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177151.869309:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145705344/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177151.869313:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177151.869321:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177151.869326:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177151.869329:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145705344:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177151.869335:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145705728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177151.869349:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177151.869353:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145705472:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177151.869356:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177151.869360:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177151.869366:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00080000:2.0:1786177151.869372:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177151.869375:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177151.869380:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177151.869387:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87d880 x1872931145705472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177151.869388:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177151.869406:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145705472/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177151.869409:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145705856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177151.869433:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177151.869437:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177151.869441:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177151.869445:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786177151.869449:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145705472:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177151.869450:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177151.869460:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00100000:1.0:1786177151.869465:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145705600:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177151.869467:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177151.869476:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177151.869482:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177151.869498:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177151.869499:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145705984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177151.869513:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177151.869515:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87c380 x1872931145705600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177151.869519:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177151.869523:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177151.869533:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00080000:2.0:1786177151.869541:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177151.869549:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177151.869550:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145705600/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177151.869559:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177151.869561:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177151.869566:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177151.869570:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145705600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177151.869578:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145705728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177151.869580:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145706112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177151.869597:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177151.869603:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177151.869608:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786177151.869609:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87df80 x1872931145705728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177151.869614:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177151.869624:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145705728/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177151.869626:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00080000:2.0:1786177151.869634:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177151.869635:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177151.869642:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177151.869644:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177151.869651:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177151.869655:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145705728:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177151.869670:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145706240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177151.869673:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145705856:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177151.869692:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177151.869696:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177151.869701:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177151.869704:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177151.869710:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10886
00000100:00100000:1.0:1786177151.869715:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87e680 x1872931145705856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177151.869717:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177151.869727:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177151.869734:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177151.869735:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145705856/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177151.869751:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145706368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177151.869753:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177151.869762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177151.869769:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145705856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177151.869777:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145705984:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177151.869795:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177151.869803:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87ca80 x1872931145705984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177151.869811:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145705984/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177151.869818:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177151.869821:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177151.869825:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145705984:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177151.869831:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145706112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177151.869850:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177151.869861:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87dc00 x1872931145706112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177151.869874:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145706112/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177151.869882:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177151.869884:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177151.869887:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145706112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177151.869916:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145706240:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177151.869932:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177151.869944:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87c700 x1872931145706240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177151.869956:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145706240/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177151.869965:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177151.869968:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177151.869972:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145706240:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177151.869978:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145706368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177151.870012:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177151.870025:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177151/real 1786177151]  req@ffff89d99e87ed80 x1872931145706368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177151.870033:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145706368/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177151.870039:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177151.870041:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177151.870043:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145706368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177152.381079:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177152.381158:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177152.892961:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177153.405032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177153.405111:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177153.917012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177154.429059:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177154.429116:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177154.940999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177155.453030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177155.453090:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177155.965056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177156.477051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177156.477120:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177156.989052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177156.989088:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177156.989097:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177156.989102:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177156.989111:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00080000:0.0:1786177156.989121:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177156.989132:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177156.989171:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145706496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177156.989209:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177156.989214:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177156.989217:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177156.989227:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00080000:0.0:1786177156.989234:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177156.989240:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177156.989252:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145706496:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786177156.989253:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177156.989284:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145706624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177156.989300:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177156.989303:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177156.989306:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177156.989311:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00080000:0.0:1786177156.989316:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177156.989320:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177156.989329:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786177156.989336:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177156.989349:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145706752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177156.989365:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177156.989369:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177156.989371:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177156.989375:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00080000:0.0:1786177156.989380:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177156.989383:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177156.989389:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177156.989394:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f3100 x1872931145706496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177156.989404:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145706880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177156.989430:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786177156.989433:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145706496/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177156.989439:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177156.989447:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177156.989458:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00080000:2.0:1786177156.989460:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177156.989464:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177156.989471:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177156.989476:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177156.989484:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145706496:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786177156.989488:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177156.989510:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145707008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786177156.989524:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145706624:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177156.989527:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177156.989538:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177156.989540:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177156.989546:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00080000:0.0:1786177156.989551:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177156.989555:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177156.989561:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1786177156.989567:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177156.989581:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145707136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786177156.989593:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f0700 x1872931145706624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177156.989602:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177156.989610:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177156.989612:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177156.989628:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00100000:2.0:1786177156.989634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145706624/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177156.989637:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177156.989654:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786177156.989659:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177156.989669:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786177156.989670:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177156.989681:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145706624:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177156.989699:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145706752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177156.989701:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145707264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177156.989719:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177156.989723:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177156.989726:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1786177156.989734:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177156.989738:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00080000:0.0:1786177156.989747:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786177156.989759:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f2d80 x1872931145706752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177156.989766:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177156.989776:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177156.989784:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145706752/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177156.989798:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786177156.989799:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145707392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177156.989805:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177156.989814:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145706752:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177156.989834:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145706880:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177156.989839:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177156.989845:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177156.989848:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177156.989855:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10891
00000100:00080000:0.0:1786177156.989863:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1786177156.989868:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177156.989874:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177156.989881:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177156.989885:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f1180 x1872931145706880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177156.989932:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145706880/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177156.989934:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145707520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177156.989955:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177156.989964:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177156.989973:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145706880:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177156.990001:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145707008:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177156.990022:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177156.990034:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f2a00 x1872931145707008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177156.990041:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145707008/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177156.990046:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177156.990048:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177156.990051:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145707008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177156.990055:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145707136:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786177156.990065:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177156.990070:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f0a80 x1872931145707136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177156.990077:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145707136/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177156.990081:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177156.990083:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177156.990085:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145707136:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177156.990088:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145707264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786177156.990097:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177156.990102:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f3b80 x1872931145707264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177156.990109:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145707264/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177156.990114:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177156.990115:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177156.990117:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145707264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177156.990120:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145707392:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177156.990128:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177156.990134:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f0e00 x1872931145707392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177156.990141:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145707392/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177156.990146:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177156.990148:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177156.990149:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145707392:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177156.990153:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145707520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177156.990162:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177156.990167:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177156/real 1786177156]  req@ffff89d9870f1500 x1872931145707520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177156.990174:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145707520/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177181 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177156.990178:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177156.990180:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177156.990181:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145707520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177157.501062:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177157.501128:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177158.013033:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177158.525047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177158.525125:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177159.037019:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177159.549044:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177159.549116:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177160.061004:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177160.573040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177160.573108:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177161.085027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177161.597009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786177161.597061:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177162.108984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786177162.109026:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109030:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786177162.109033:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177162.109042:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00080000:1.0:1786177162.109052:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177162.109065:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177162.109106:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145707648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177162.109133:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109137:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177162.109139:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177162.109144:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00080000:1.0:1786177162.109149:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177162.109153:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177162.109164:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177162.109176:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145707648:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177162.109180:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc380 x1872931145707776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177162.109196:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109198:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177162.109200:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177162.109203:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00080000:1.0:1786177162.109205:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177162.109207:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177162.109211:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177162.109219:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff100 x1872931145707904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177162.109226:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109228:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177162.109229:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177162.109232:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00080000:1.0:1786177162.109234:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177162.109236:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177162.109240:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177162.109246:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd180 x1872931145708032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177162.109252:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109256:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1786177162.109258:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177162.109259:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177162.109266:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00080000:1.0:1786177162.109270:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177162.109273:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177162.109276:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177162.109284:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fed80 x1872931145708160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177162.109290:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109292:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177162.109294:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177162.109297:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00080000:1.0:1786177162.109300:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177162.109303:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177162.109307:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177162.109308:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2ffb80 x1872931145707648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177162.109316:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fea00 x1872931145708288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177162.109324:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109326:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177162.109327:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177162.109335:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00080000:1.0:1786177162.109339:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177162.109342:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177162.109345:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177162.109352:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145707648/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177162.109354:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdf80 x1872931145708416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177162.109393:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177162.109394:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109401:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177162.109403:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177162.109406:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177162.109409:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00080000:1.0:1786177162.109413:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786177162.109417:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145707648:192.168.202.130@tcp:250:kworker.0
00000100:00080000:1.0:1786177162.109419:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177162.109426:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177162.109434:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff800 x1872931145708544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177162.109440:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177162.109443:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177162.109444:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177162.109450:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10896
00000100:00100000:2.0:1786177162.109451:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145707776:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177162.109452:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177162.109458:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177162.109464:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177162.109473:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ffb80 x1872931145708672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1786177162.109491:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177162.109508:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2fc380 x1872931145707776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177162.109523:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc380 x1872931145707776/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177162.109531:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177162.109535:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177162.109538:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145707776:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177162.109545:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145707904:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786177162.109566:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177162.109578:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2ff100 x1872931145707904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177162.109590:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff100 x1872931145707904/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177162.109598:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177162.109602:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177162.109605:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145707904:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177162.109612:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145708032:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177162.109631:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177162.109643:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2fd180 x1872931145708032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177162.109654:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd180 x1872931145708032/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177162.109661:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177162.109664:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177162.109668:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145708032:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177162.109674:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145708160:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177162.109695:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177162.109705:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2fed80 x1872931145708160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177162.109713:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fed80 x1872931145708160/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177162.109718:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177162.109729:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177162.109732:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145708160:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177162.109736:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145708288:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786177162.109749:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177162.109757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2fea00 x1872931145708288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177162.109769:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fea00 x1872931145708288/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177162.109775:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177162.109777:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177162.109779:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145708288:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177162.109782:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145708416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786177162.109793:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177162.109799:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2fdf80 x1872931145708416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177162.109807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdf80 x1872931145708416/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177162.109819:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177162.109820:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177162.109822:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145708416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177162.109827:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145708544:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177162.109838:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177162.109845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2ff800 x1872931145708544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177162.109852:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff800 x1872931145708544/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177162.109862:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177162.109864:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177162.109866:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145708544:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177162.109880:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145708672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177162.109933:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177162.109943:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177162/real 1786177162]  req@ffff89d9ba2ffb80 x1872931145708672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177162.109951:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ffb80 x1872931145708672/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177162.109957:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177162.109959:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177162.109961:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145708672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177162.621015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177162.621102:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177163.133017:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177163.645025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177163.645089:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177164.156999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177164.669039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177164.669110:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177165.181045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177165.692966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177165.693016:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177166.205008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177166.717019:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177166.717074:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1786177167.229024:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177167.229034:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1786177167.229039:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177167.229049:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10901
00000100:00100000:0.0:1786177167.229052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:1.0:1786177167.229059:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177167.229069:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177167.229108:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145708800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177167.229144:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177167.229149:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177167.229151:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177167.229159:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10901
00000100:00080000:1.0:1786177167.229164:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177167.229168:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177167.229176:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177167.229179:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145708800:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177167.229190:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2ff480 x1872931145708928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177167.229203:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177167.229207:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177167.229209:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177167.229214:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10901
00000100:00080000:1.0:1786177167.229219:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177167.229224:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177167.229230:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177167.229247:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fdc00 x1872931145709056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177167.229256:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177167.229260:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1786177167.229261:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177167.229264:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10901
00000100:00080000:1.0:1786177167.229267:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177167.229270:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177167.229274:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1786177167.229281:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177167.229288:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe300 x1872931145709184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177167.229296:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177167.229299:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177167.229300:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177167.229305:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10901
00000100:00080000:1.0:1786177167.229311:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177167.229314:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177167.229317:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177167.229327:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fe680 x1872931145709312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177167.229336:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177167.229342:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1786177167.229343:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2fd500 x1872931145708800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177167.229347:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177167.229362:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10901
00000100:00100000:2.0:1786177167.229373:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145708800/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177167.229380:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177167.229386:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177167.229391:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:2.0:1786177167.229395:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:1.0:1786177167.229407:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177167.229408:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145708800:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177167.229432:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd880 x1872931145709440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177167.229448:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1786177167.229454:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145708928:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177167.229456:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:1.0:1786177167.229462:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177167.229468:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10901
00000100:00080000:1.0:1786177167.229472:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177167.229476:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:2.0:1786177167.229486:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:1.0:1786177167.229490:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177167.229500:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2ff480 x1872931145708928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177167.229507:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fce00 x1872931145709568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786177167.229540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2ff480 x1872931145708928/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177167.229547:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177167.229551:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177167.229556:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177167.229558:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:1.0:1786177167.229561:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1786177167.229566:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145708928:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177167.229575:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10901
00000100:00080000:1.0:1786177167.229581:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1786177167.229587:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145709056:192.168.202.130@tcp:38:kworker.0
00000100:00080000:1.0:1786177167.229589:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177167.229598:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177167.229614:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fc700 x1872931145709696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177167.229622:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177167.229625:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177167.229626:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177167.229633:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10901
00000800:00000100:2.0:1786177167.229637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:1.0:1786177167.229641:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177167.229648:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:1.0:1786177167.229656:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177167.229671:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2fdc00 x1872931145709056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177167.229674:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9ba2fd500 x1872931145709824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786177167.229704:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fdc00 x1872931145709056/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177167.229714:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177167.229718:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177167.229720:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145709056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177167.229727:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145709184:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177167.229749:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177167.229757:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2fe300 x1872931145709184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177167.229766:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe300 x1872931145709184/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177167.229771:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177167.229773:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177167.229775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145709184:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177167.229779:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145709312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177167.229790:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177167.229796:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2fe680 x1872931145709312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177167.229804:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fe680 x1872931145709312/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177167.229809:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177167.229811:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177167.229813:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145709312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177167.229826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145709440:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786177167.229837:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177167.229858:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2fd880 x1872931145709440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177167.229867:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd880 x1872931145709440/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177167.229878:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177167.229880:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177167.229882:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145709440:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177167.229886:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145709568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:2.0:1786177167.229920:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177167.229930:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2fce00 x1872931145709568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177167.229944:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fce00 x1872931145709568/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177167.229952:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177167.229956:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177167.229960:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145709568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177167.229967:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145709696:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177167.229989:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177167.230001:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2fc700 x1872931145709696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177167.230014:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fc700 x1872931145709696/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177167.230023:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177167.230026:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177167.230030:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145709696:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177167.230043:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145709824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177167.230065:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177167.230074:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177167/real 1786177167]  req@ffff89d9ba2fd500 x1872931145709824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177167.230082:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9ba2fd500 x1872931145709824/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177167.230088:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177167.230090:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177167.230092:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9ba2fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145709824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177167.741047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177167.741147:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177168.253067:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177168.765037:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:3.0:1786177168.765075:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177169.277036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177169.789018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177169.789073:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177170.301005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177170.812999:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177170.813060:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177171.325020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177171.837007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177171.837075:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786177172.349006:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177172.349015:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177172.349019:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177172.349028:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00080000:3.0:1786177172.349036:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177172.349043:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177172.349078:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145709952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1786177172.349092:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177172.349121:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177172.349124:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177172.349126:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177172.349134:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00080000:3.0:1786177172.349138:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177172.349142:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177172.349150:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177172.349152:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145709952:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786177172.349166:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145710080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177172.349179:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177172.349183:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177172.349185:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177172.349189:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00080000:3.0:1786177172.349194:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177172.349200:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177172.349206:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177172.349208:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:3.0:1786177172.349224:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145710208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177172.349236:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177172.349240:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177172.349242:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177172.349247:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe64000 x1872931145709952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177172.349250:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00080000:3.0:1786177172.349258:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177172.349265:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177172.349268:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145709952/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786177172.349273:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177172.349277:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177172.349282:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177172.349285:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145709952:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786177172.349291:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145710336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177172.349303:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177172.349307:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145710080:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177172.349308:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177172.349313:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177172.349319:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00080000:3.0:1786177172.349326:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177172.349332:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177172.349333:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177172.349341:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177172.349346:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe65180 x1872931145710080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177172.349357:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65880 x1872931145710464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177172.349359:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145710080/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177172.349391:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786177172.349391:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177172.349399:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177172.349400:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786177172.349403:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177172.349409:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145710080:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177172.349410:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00080000:3.0:1786177172.349419:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177172.349424:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145710208:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177172.349427:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177172.349435:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177172.349450:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66680 x1872931145710592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177172.349459:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177172.349471:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe66300 x1872931145710208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177172.349476:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177172.349486:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177172.349489:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177172.349493:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145710208/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177172.349497:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00080000:3.0:1786177172.349505:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177172.349507:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786177172.349511:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177172.349513:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177172.349519:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145710208:192.168.202.130@tcp:38:kworker.0
00000008:00100000:3.0:1786177172.349520:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177172.349526:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145710336:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177172.349537:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67480 x1872931145710720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177172.349544:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177172.349553:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177172.349555:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe64a80 x1872931145710336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177172.349564:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177172.349568:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177172.349576:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00100000:1.0:1786177172.349577:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145710336/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177172.349580:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177172.349589:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177172.349592:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177172.349594:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145710336:192.168.202.130@tcp:8:kworker.0
00000100:00080000:3.0:1786177172.349600:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177172.349607:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177172.349612:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145710464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177172.349626:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67800 x1872931145710848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177172.349638:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177172.349640:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177172.349646:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177172.349648:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177172.349655:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10906
00000100:00100000:1.0:1786177172.349656:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe65880 x1872931145710464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177172.349663:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177172.349671:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177172.349679:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177172.349682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65880 x1872931145710464/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177172.349695:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1786177172.349695:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64a80 x1872931145710976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177172.349703:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177172.349714:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145710464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177172.349724:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145710592:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177172.349747:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177172.349756:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe66680 x1872931145710592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177172.349764:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66680 x1872931145710592/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177172.349770:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177172.349772:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177172.349775:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145710592:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177172.349779:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145710720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177172.349789:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177172.349821:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe67480 x1872931145710720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177172.349830:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67480 x1872931145710720/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177172.349835:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177172.349837:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177172.349839:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145710720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177172.349849:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145710848:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177172.349862:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177172.349869:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe67800 x1872931145710848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177172.349876:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67800 x1872931145710848/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177172.349881:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177172.349883:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177172.349885:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145710848:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177172.349888:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145710976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177172.349914:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177172.349922:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177172/real 1786177172]  req@ffff89d99fe64a80 x1872931145710976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177172.349931:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64a80 x1872931145710976/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177172.349936:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177172.349938:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177172.349940:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145710976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177172.860979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177172.861072:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177173.373059:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177173.885067:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177173.885148:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177174.397024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177174.909015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177174.909096:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177175.421082:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177175.933045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177175.933136:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177176.445057:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177176.957009:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177176.957083:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177177.468989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:3.0:1786177177.468993:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469002:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177177.469007:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469019:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469030:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469040:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177177.469082:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66300 x1872931145711104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177177.469108:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469111:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177177.469112:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469116:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469119:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469124:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177177.469134:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177177.469151:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65180 x1872931145711232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177177.469153:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145711104:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177177.469181:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469185:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177177.469187:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469195:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469200:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469204:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177177.469211:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177177.469227:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145711360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177177.469237:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469240:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177177.469242:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469244:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469248:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469254:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177177.469256:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:3.0:1786177177.469264:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177177.469279:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145711488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177177.469287:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469290:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177177.469292:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469296:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469302:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469307:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177177.469311:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177177.469320:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe66300 x1872931145711104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177177.469329:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145711616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177177.469365:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469368:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786177177.469372:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66300 x1872931145711104/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177177.469372:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469388:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469393:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469399:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177177.469400:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1786177177.469404:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177177.469411:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.469420:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145711104:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786177177.469421:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145711744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177177.469442:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469445:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177177.469447:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469451:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469453:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469455:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177177.469460:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177177.469464:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145711232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:3.0:1786177177.469475:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145711872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177177.469484:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469488:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1786177177.469493:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177177.469493:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469505:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469508:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469513:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177177.469516:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177177.469527:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145712000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177177.469529:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe65180 x1872931145711232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177177.469553:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177177.469567:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177177.469572:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177177.469579:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10911
00000100:00080000:3.0:1786177177.469583:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177177.469589:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177177.469591:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65180 x1872931145711232/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1786177177.469593:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177177.469603:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145712128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177177.469636:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177177.469644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.469651:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145711232:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177177.469661:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145711360:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177177.469688:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177177.469701:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe64000 x1872931145711360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177177.469712:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145711360/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177177.469721:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177177.469725:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.469727:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145711360:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177177.469734:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145711488:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177177.469771:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177177.469794:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe64380 x1872931145711488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177177.469805:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145711488/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177177.469813:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177177.469816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.469820:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145711488:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177177.469826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145711616:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177177.469846:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177177.469858:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe67b80 x1872931145711616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177177.469869:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145711616/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177177.469877:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177177.469880:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.469883:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145711616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177177.469890:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145711744:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177177.469947:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177177.469956:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe65f80 x1872931145711744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177177.469965:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145711744/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177177.469971:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177177.469973:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.469975:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145711744:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177177.469992:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145711872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177177.470015:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177177.470022:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe66d80 x1872931145711872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177177.470030:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145711872/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177177.470035:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177177.470037:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.470039:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145711872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177177.470043:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145712000:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177177.470054:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177177.470060:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe65500 x1872931145712000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177177.470068:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145712000/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177177.470073:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177177.470075:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.470077:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145712000:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177177.470081:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145712128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177177.470090:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177177.470103:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177177/real 1786177177]  req@ffff89d99fe66a00 x1872931145712128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177177.470110:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145712128/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177177.470116:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177177.470118:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177177.470120:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145712128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177177.981025:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177177.981092:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177178.493069:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177179.005021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177179.005100:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177179.516984:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177180.029000:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177180.029084:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177180.541008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177181.053020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177181.053086:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177181.564969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177182.077022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177182.077077:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177182.589020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177182.589031:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589039:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177182.589044:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589055:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589065:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589073:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177182.589111:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145712256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177182.589143:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589147:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177182.589149:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589153:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589158:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589173:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177182.589183:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177182.589197:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145712384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177182.589207:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589211:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177182.589213:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589217:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589221:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589225:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177182.589230:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177182.589242:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145712512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177182.589252:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589256:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177182.589257:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589261:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589265:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589269:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177182.589275:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177182.589288:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145712640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177182.589298:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589302:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177182.589304:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589307:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589323:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589327:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177182.589331:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177182.589343:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145712768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177182.589352:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589355:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177182.589357:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589361:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589364:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589368:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177182.589372:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177182.589382:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145712896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177182.589399:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589402:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177182.589404:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589407:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589410:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589413:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177182.589417:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177182.589424:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145713024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177182.589432:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589436:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177182.589437:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589441:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589445:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589449:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177182.589453:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177182.589464:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145713152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177182.589472:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177182.589475:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177182.589477:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177182.589481:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10916
00000100:00080000:2.0:1786177182.589485:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177182.589489:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177182.589494:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177182.589504:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145713280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177182.589558:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145712256:192.168.202.130@tcp:250:kworker.0
00000800:00000100:1.0:1786177182.589624:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.589657:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87d500 x1872931145712256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.589671:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145712256/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.589678:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.589681:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.589685:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145712256:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177182.589690:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145712384:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177182.589724:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.589733:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87c000 x1872931145712384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.589746:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145712384/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.589753:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.589755:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.589757:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145712384:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177182.589761:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145712512:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177182.589779:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.589790:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87f100 x1872931145712512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.589803:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145712512/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.589812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.589816:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.589819:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145712512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177182.589826:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145712640:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177182.589847:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.589859:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87ed80 x1872931145712640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.589873:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145712640/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.589888:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.589890:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.589893:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145712640:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177182.589915:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145712768:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177182.589932:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.589940:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87c700 x1872931145712768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.589948:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145712768/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.589953:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.589955:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.589957:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145712768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177182.589961:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145712896:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177182.589971:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.589977:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87dc00 x1872931145712896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.589985:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145712896/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.589990:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.589992:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.589994:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145712896:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177182.589997:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145713024:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177182.590007:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.590013:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87ca80 x1872931145713024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.590019:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145713024/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.590024:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.590025:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.590027:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145713024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177182.590030:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145713152:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177182.590039:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.590045:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87e680 x1872931145713152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.590056:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145713152/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.590063:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.590067:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.590070:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145713152:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177182.590076:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145713280:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177182.590096:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177182.590107:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177182/real 1786177182]  req@ffff89d99e87df80 x1872931145713280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177182.590116:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145713280/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177182.590122:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177182.590124:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177182.590126:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145713280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177183.100991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177183.101068:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177183.612999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177184.124998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177184.125064:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177184.637018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177185.148966:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177185.149063:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177185.660999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177186.173015:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177186.173088:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177186.684987:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177187.197008:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177187.197069:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786177187.709011:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177187.709012:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177187.709021:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177187.709025:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177187.709033:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709042:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177187.709049:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177187.709084:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145713408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177187.709113:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177187.709117:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177187.709119:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177187.709124:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709128:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177187.709132:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177187.709141:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145713408:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786177187.709142:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177187.709157:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145713536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177187.709166:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177187.709169:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177187.709171:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177187.709174:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709176:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177187.709178:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177187.709182:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177187.709190:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145713664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177187.709197:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177187.709199:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177187.709201:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177187.709203:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709205:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177187.709208:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177187.709211:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177187.709218:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145713792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177187.709224:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177187.709227:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177187.709228:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177187.709231:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709233:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177187.709235:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177187.709239:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177187.709246:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145713920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177187.709252:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145713536:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177187.709258:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177187.709261:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177187.709262:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177187.709266:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709268:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177187.709271:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177187.709274:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177187.709283:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145714048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177187.709288:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145713664:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177187.709296:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177187.709300:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177187.709301:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177187.709305:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709308:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177187.709311:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177187.709314:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177187.709315:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145713792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177187.709326:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145714176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177187.709339:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177187.709340:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145713920:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177187.709354:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786177187.709358:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145714048:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177187.709364:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177187.709372:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709378:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177187.709381:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145714176:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177187.709387:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177187.709394:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177187.709411:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145714304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177187.709425:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177187.709429:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177187.709431:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177187.709436:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145714304:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177187.709441:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10921
00000100:00080000:2.0:1786177187.709448:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177187.709456:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177187.709462:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177187.709476:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145714432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177187.709506:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145714432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177188.220996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177188.221065:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177188.733009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177189.245045:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177189.245105:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177189.756995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177190.268997:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177190.269063:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177190.781010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:2.0:1786177190.781224:0:2381:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:2.0:1786177190.781259:0:2381:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1786177190.781276:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786177190.781323:0:2381:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:2.0:1786177190.781340:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786177190.781354:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786177190.781356:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87ed80 x1872931145714432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786177190.781367:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:2.0:1786177190.781383:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786177190.781391:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145714432/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1786177190.781400:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786177190.781415:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000800:00000100:2.0:1786177190.781420:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00080000:1.0:1786177190.781425:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781434:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145714432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:2.0:1786177190.781434:0:2381:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:1.0:1786177190.781448:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87c700 x1872931145714304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177190.781464:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145714304/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177190.781473:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177190.781477:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781481:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145714304:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177190.781487:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87dc00 x1872931145714176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177190.781507:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145714176/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177190.781515:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177190.781518:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781521:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145714176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177190.781528:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87e680 x1872931145713920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177190.781540:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145713920/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177190.781548:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177190.781551:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781554:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145713920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177190.781560:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87ca80 x1872931145714048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177190.781573:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145714048/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177190.781581:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177190.781584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781587:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145714048:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177190.781594:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87d880 x1872931145713536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177190.781607:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145713536/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177190.781630:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177190.781633:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145713536:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177190.781644:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87f800 x1872931145713664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177190.781657:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145713664/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177190.781665:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177190.781668:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781671:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145713664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177190.781677:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87df80 x1872931145713792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177190.781688:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145713792/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177190.781696:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177190.781699:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781702:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145713792:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177190.781708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177187/real 1786177190]  req@ffff89d99e87c380 x1872931145713408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177190.781721:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145713408/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177190.781728:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177190.781731:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177190.781734:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145713408:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786177191.293042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177191.293120:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177191.804969:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177192.316982:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177192.317060:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786177192.828998:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177192.829001:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177192.829009:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177192.829013:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829023:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10927
00000100:00080000:2.0:1786177192.829032:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177192.829040:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177192.829070:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145714560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177192.829094:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177192.829097:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177192.829098:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829101:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10927
00000100:00080000:2.0:1786177192.829103:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177192.829105:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177192.829113:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177192.829122:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145714688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177192.829133:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177192.829136:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177192.829138:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829143:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10927
00000100:00080000:2.0:1786177192.829148:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177192.829155:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177192.829161:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177192.829164:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145714560:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177192.829175:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145714816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177192.829188:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177192.829192:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177192.829194:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829199:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10927
00000100:00080000:2.0:1786177192.829204:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177192.829208:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177192.829214:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177192.829227:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145714944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177192.829237:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177192.829245:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177192.829250:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177192.829252:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829257:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10927
00000100:00080000:2.0:1786177192.829262:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177192.829266:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177192.829272:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177192.829287:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145715072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177192.829290:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87f100 x1872931145714560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177192.829325:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177192.829331:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145714560/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177192.829332:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177192.829337:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829346:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10927
00000100:00080000:2.0:1786177192.829354:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177192.829355:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177192.829361:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177192.829364:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000008:00100000:2.0:1786177192.829371:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177192.829372:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145714560:192.168.202.130@tcp:250:kworker.0
00000100:00100000:1.0:1786177192.829386:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145714688:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177192.829391:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145715200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177192.829403:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177192.829407:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177192.829410:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829414:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10927
00000800:00000100:1.0:1786177192.829420:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177192.829422:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177192.829429:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177192.829436:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177192.829441:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87c000 x1872931145714688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177192.829453:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145715328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177192.829460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145714688/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177192.829470:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177192.829474:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177192.829476:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829485:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10927
00000100:00080000:1.0:1786177192.829487:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177192.829492:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177192.829495:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177192.829501:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177192.829506:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145714688:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786177192.829509:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177192.829532:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145715456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177192.829537:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145714816:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177192.829553:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177192.829557:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177192.829560:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177192.829565:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10927
00000100:00080000:2.0:1786177192.829570:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177192.829573:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177192.829578:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177192.829585:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177192.829630:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87d500 x1872931145714816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177192.829645:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145714816/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177192.829653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177192.829657:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177192.829660:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145714816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177192.829666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145714944:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177192.829689:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177192.829702:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87c380 x1872931145714944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177192.829714:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145714944/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177192.829723:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177192.829726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177192.829729:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145714944:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177192.829737:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145715072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177192.829758:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177192.829770:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87df80 x1872931145715072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177192.829781:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145715072/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177192.829789:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177192.829792:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177192.829795:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145715072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177192.829801:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145715200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177192.829825:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145715584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177192.829827:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177192.829845:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87f800 x1872931145715200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177192.829859:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145715200/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177192.829868:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177192.829873:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177192.829877:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145715200:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177192.829885:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145715328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177192.829930:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177192.829943:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87d880 x1872931145715328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177192.829958:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145715328/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177192.829967:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177192.829971:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177192.829975:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145715328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177192.830000:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145715456:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177192.830023:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177192.830036:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87ca80 x1872931145715456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177192.830049:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145715456/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177192.830057:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177192.830061:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177192.830066:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145715456:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177192.830075:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145715584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177192.830101:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177192.830118:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177192/real 1786177192]  req@ffff89d99e87e680 x1872931145715584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177192.830131:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145715584/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177192.830143:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177192.830148:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177192.830153:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145715584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177193.341013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177193.341069:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177193.852979:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177194.365030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177194.365088:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177194.876997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177195.389026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177195.389094:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177195.900980:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177196.412990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177196.413013:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177196.924994:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177197.436974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177197.437053:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177197.948997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177197.949022:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177197.949029:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177197.949033:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177197.949041:0:185474:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949048:0:185474:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177197.949054:0:185474:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177197.949083:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145715712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177197.949104:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177197.949108:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177197.949109:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177197.949112:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949115:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177197.949118:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177197.949127:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177197.949138:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145715712:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177197.949139:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145715840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177197.949152:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177197.949154:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177197.949155:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177197.949159:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949161:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177197.949163:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177197.949168:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177197.949177:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145715968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177197.949184:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177197.949186:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177197.949187:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177197.949189:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949192:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177197.949195:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177197.949199:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786177197.949202:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177197.949213:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145716096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177197.949219:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177197.949222:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177197.949223:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177197.949226:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949229:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177197.949231:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177197.949235:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177197.949236:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f3480 x1872931145715712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177197.949245:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145716224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177197.949253:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145715712/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177197.949254:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177197.949266:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1786177197.949269:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177197.949270:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177197.949274:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177197.949282:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145715712:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177197.949283:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949291:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177197.949297:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177197.949304:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177197.949305:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145715840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177197.949323:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145716352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177197.949330:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177197.949338:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177197.949341:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177197.949343:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177197.949344:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f2680 x1872931145715840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177197.949349:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949356:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177197.949362:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145715840/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177197.949363:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177197.949371:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177197.949377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177197.949382:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177197.949385:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145716480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177197.949387:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145715840:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177197.949398:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145715968:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177197.949402:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177197.949405:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177197.949407:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177197.949411:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949415:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177197.949419:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177197.949423:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177197.949429:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177197.949433:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f1880 x1872931145715968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177197.949441:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145716608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177197.949446:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145715968/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177197.949461:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177197.949463:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177197.949466:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177197.949469:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177197.949470:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177197.949475:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145715968:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177197.949478:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10932
00000100:00080000:0.0:1786177197.949483:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177197.949486:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145716096:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177197.949489:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177197.949495:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177197.949506:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145716736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177197.949510:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177197.949521:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f1500 x1872931145716096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177197.949530:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145716096/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177197.949535:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177197.949538:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177197.949540:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145716096:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177197.949568:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145716224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177197.949592:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177197.949599:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f0e00 x1872931145716224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177197.949607:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145716224/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177197.949613:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177197.949614:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177197.949617:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145716224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177197.949628:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145716352:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177197.949639:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177197.949645:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f3b80 x1872931145716352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177197.949652:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145716352/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177197.949657:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177197.949659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177197.949661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145716352:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177197.949664:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145716480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177197.949674:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177197.949680:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f0a80 x1872931145716480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177197.949687:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145716480/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177197.949692:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177197.949694:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177197.949695:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145716480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177197.949699:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145716608:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177197.949708:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177197.949713:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f2a00 x1872931145716608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177197.949719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145716608/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177197.949724:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177197.949726:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177197.949728:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145716608:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177197.949731:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145716736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177197.949740:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177197.949745:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177197/real 1786177197]  req@ffff89d9870f1180 x1872931145716736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177197.949752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145716736/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177197.949757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177197.949759:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177197.949761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145716736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177198.460996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177198.461067:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177198.972999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177199.485020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177199.485089:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177199.997058:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177200.508990:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177200.509043:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177201.021014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177201.533013:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177201.533082:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177202.045068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177202.557040:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177202.557129:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177203.069005:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177203.069013:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177203.069022:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177203.069029:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177203.069042:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00080000:2.0:1786177203.069056:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177203.069066:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177203.069115:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145716864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177203.069155:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177203.069160:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177203.069162:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177203.069168:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00080000:2.0:1786177203.069173:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177203.069178:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177203.069190:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145716864:192.168.202.130@tcp:250:kworker.0
00000008:00100000:2.0:1786177203.069192:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177203.069213:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145716992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177203.069225:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177203.069229:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177203.069232:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177203.069237:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00080000:2.0:1786177203.069241:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177203.069246:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177203.069252:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177203.069266:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145717120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177203.069279:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177203.069279:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177203.069285:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177203.069288:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177203.069294:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00080000:2.0:1786177203.069299:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177203.069304:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177203.069311:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177203.069328:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87dc00 x1872931145716864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177203.069331:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145717248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177203.069354:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177203.069358:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145716864/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177203.069360:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177203.069365:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177203.069374:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177203.069376:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00080000:1.0:1786177203.069381:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177203.069385:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177203.069386:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145716864:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177203.069395:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177203.069402:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177203.069416:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145716992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177203.069418:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145717376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177203.069433:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177203.069437:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:1.0:1786177203.069440:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177203.069442:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177203.069450:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00100000:1.0:1786177203.069454:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87c700 x1872931145716992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177203.069458:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177203.069469:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177203.069472:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145716992/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177203.069478:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177203.069482:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177203.069485:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177203.069488:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145716992:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177203.069493:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145717120:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177203.069511:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145717504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177203.069528:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177203.069539:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177203.069540:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87ed80 x1872931145717120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177203.069549:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177203.069555:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177203.069558:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145717120/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177203.069563:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00080000:1.0:1786177203.069571:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177203.069573:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177203.069576:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177203.069581:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145717120:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177203.069584:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177203.069590:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145717248:192.168.202.130@tcp:8:kworker.0
00000008:00100000:2.0:1786177203.069595:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177203.069608:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177203.069615:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145717632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177203.069619:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87e680 x1872931145717248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177203.069632:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177203.069644:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1786177203.069647:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145717248/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177203.069647:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177203.069658:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00080000:1.0:1786177203.069659:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177203.069667:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177203.069667:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177203.069672:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145717248:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177203.069679:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177203.069686:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177203.069689:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145717376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177203.069706:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145717760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177203.069710:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177203.069722:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87ca80 x1872931145717376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177203.069725:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177203.069737:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177203.069740:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177203.069741:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145717376/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177203.069750:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10937
00000100:00080000:1.0:1786177203.069752:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177203.069758:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177203.069759:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177203.069762:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145717376:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177203.069771:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145717504:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177203.069771:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177203.069783:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177203.069789:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177203.069803:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145717888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177203.069804:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87d880 x1872931145717504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177203.069826:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145717504/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177203.069836:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177203.069840:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177203.069844:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145717504:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177203.069852:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145717632:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177203.069874:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177203.069887:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87f800 x1872931145717632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177203.069914:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145717632/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177203.069921:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177203.069923:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177203.069927:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145717632:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177203.069942:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145717760:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177203.069965:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177203.069978:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87df80 x1872931145717760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177203.069990:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145717760/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177203.069997:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177203.069999:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177203.070001:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145717760:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177203.070006:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145717888:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177203.070020:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177203.070027:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177203/real 1786177203]  req@ffff89d99e87c380 x1872931145717888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177203.070034:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145717888/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177203.070040:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177203.070043:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177203.070045:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145717888:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177203.581032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177203.581103:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177204.093024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177204.604964:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177204.605057:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177205.117036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177205.629007:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177205.629100:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177206.141056:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177206.653006:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177206.653017:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177207.165018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177207.677048:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177207.677159:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177208.189036:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177208.189067:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177208.189075:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177208.189080:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177208.189092:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10942
00000100:00080000:0.0:1786177208.189103:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177208.189110:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177208.189146:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145718016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177208.189182:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177208.189186:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177208.189188:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177208.189192:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10942
00000100:00080000:0.0:1786177208.189195:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177208.189199:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177208.189208:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177208.189220:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145718016:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177208.189224:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145718144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177208.189236:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177208.189239:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177208.189241:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177208.189246:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10942
00000100:00080000:0.0:1786177208.189250:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177208.189254:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177208.189259:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177208.189270:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145718272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177208.189280:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177208.189283:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177208.189288:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177208.189290:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177208.189295:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10942
00000100:00080000:0.0:1786177208.189299:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177208.189304:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177208.189309:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177208.189318:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f2d80 x1872931145718016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177208.189325:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145718400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177208.189345:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177208.189349:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177208.189351:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177208.189353:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145718016/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177208.189361:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10942
00000100:00080000:1.0:1786177208.189368:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177208.189369:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177208.189377:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177208.189378:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177208.189385:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145718016:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786177208.189386:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177208.189401:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145718528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177208.189407:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145718144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177208.189419:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177208.189424:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177208.189426:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177208.189433:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10942
00000800:00000100:1.0:1786177208.189433:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177208.189440:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177208.189461:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177208.189463:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f0700 x1872931145718144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177208.189469:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177208.189490:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145718144/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177208.189491:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145718656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177208.189513:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177208.189522:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177208.189531:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145718144:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177208.189533:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177208.189543:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145718272:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177208.189547:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177208.189552:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177208.189557:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10942
00000100:00080000:0.0:1786177208.189562:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177208.189566:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177208.189572:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177208.189573:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177208.189589:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145718784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177208.189589:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f3100 x1872931145718272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177208.189625:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177208.189626:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145718272/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177208.189635:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177208.189640:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177208.189642:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177208.189648:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10942
00000100:00080000:0.0:1786177208.189653:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177208.189655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177208.189664:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177208.189664:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145718272:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177208.189675:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145718400:192.168.202.130@tcp:8:kworker.0
00000008:00100000:0.0:1786177208.189676:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177208.189693:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145718912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177208.189702:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177208.189709:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177208.189713:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177208.189715:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177208.189720:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f1180 x1872931145718400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177208.189723:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10942
00000100:00080000:0.0:1786177208.189730:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177208.189737:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177208.189742:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177208.189754:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145718400/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177208.189758:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145719040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177208.189787:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177208.189792:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177208.189796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145718400:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177208.189811:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145718528:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177208.189827:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177208.189835:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f2a00 x1872931145718528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177208.189842:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145718528/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177208.189847:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177208.189849:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177208.189851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145718528:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177208.189855:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145718656:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177208.189864:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177208.189869:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f0a80 x1872931145718656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177208.189881:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145718656/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177208.189888:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177208.189892:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177208.189895:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145718656:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177208.189931:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145718784:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177208.189948:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177208.189956:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f3b80 x1872931145718784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177208.189964:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145718784/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177208.189969:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177208.189971:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177208.189973:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145718784:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177208.189977:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145718912:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177208.189986:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177208.189992:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f0e00 x1872931145718912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177208.189999:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145718912/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177208.190004:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177208.190006:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177208.190008:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145718912:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177208.190011:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145719040:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177208.190020:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177208.190026:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177208/real 1786177208]  req@ffff89d9870f1500 x1872931145719040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177208.190033:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145719040/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177208.190038:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177208.190040:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177208.190042:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145719040:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177208.700991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177208.701081:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177209.212997:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177209.725030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177209.725090:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177210.237021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177210.748974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177210.749049:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177211.260975:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177211.772969:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177211.773033:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177212.285009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177212.797088:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177212.797165:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786177213.309057:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177213.309069:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177213.309075:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177213.309084:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177213.309089:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309105:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177213.309115:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177213.309167:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145719168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177213.309195:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177213.309198:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177213.309200:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177213.309203:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309206:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177213.309209:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177213.309220:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177213.309229:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145719168:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177213.309235:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145719296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177213.309245:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177213.309247:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177213.309249:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177213.309252:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309255:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177213.309257:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177213.309260:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177213.309271:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145719424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177213.309278:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177213.309281:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177213.309282:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177213.309284:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309300:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177213.309302:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177213.309306:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177213.309314:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177213.309323:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145719552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177213.309332:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177213.309335:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177213.309336:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177213.309340:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309344:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177213.309346:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177213.309350:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177213.309361:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145719680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177213.309364:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f1880 x1872931145719168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177213.309382:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177213.309386:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177213.309388:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177213.309391:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309412:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177213.309416:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177213.309419:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145719168/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177213.309421:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177213.309435:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145719808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177213.309436:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177213.309445:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177213.309449:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177213.309452:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145719168:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177213.309454:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177213.309459:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177213.309463:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309466:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177213.309469:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177213.309472:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177213.309480:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145719936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177213.309483:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145719296:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177213.309506:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177213.309509:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177213.309511:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177213.309514:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309518:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177213.309519:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177213.309523:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177213.309527:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177213.309534:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f2680 x1872931145719296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177213.309539:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145720064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177213.309553:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177213.309555:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145719296/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177213.309559:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177213.309563:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177213.309570:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10947
00000100:00080000:0.0:1786177213.309573:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177213.309573:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177213.309579:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00080000:1.0:1786177213.309584:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000008:00100000:0.0:1786177213.309585:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177213.309593:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145719296:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177213.309596:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145720192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177213.309607:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145719424:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177213.309633:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177213.309642:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f3480 x1872931145719424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177213.309651:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145719424/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177213.309657:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177213.309659:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177213.309661:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145719424:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177213.309666:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145719552:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177213.309686:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177213.309697:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f1500 x1872931145719552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177213.309719:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145719552/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177213.309726:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177213.309729:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177213.309731:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145719552:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177213.309736:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145719680:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177213.309751:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177213.309759:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f0e00 x1872931145719680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177213.309766:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145719680/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177213.309772:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177213.309774:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177213.309776:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145719680:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177213.309779:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145719808:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177213.309789:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177213.309795:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f3b80 x1872931145719808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177213.309802:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145719808/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177213.309812:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177213.309814:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177213.309816:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145719808:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177213.309829:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145719936:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177213.309840:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177213.309846:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f0a80 x1872931145719936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177213.309853:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145719936/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177213.309859:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177213.309860:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177213.309862:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145719936:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177213.309866:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145720064:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177213.309876:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177213.309882:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f2a00 x1872931145720064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177213.309889:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145720064/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177213.309894:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177213.309915:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177213.309919:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145720064:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177213.309923:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145720192:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177213.309936:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177213.309943:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177213/real 1786177213]  req@ffff89d9870f1180 x1872931145720192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177213.309951:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145720192/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177213.309957:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177213.309959:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177213.309961:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145720192:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177213.820965:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177213.821055:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177214.333044:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177214.845038:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177214.845110:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177215.357146:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177215.869005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177215.869086:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177216.381002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177216.893002:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177216.893069:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1786177217.405018:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177217.916974:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177217.917092:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786177218.428983:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177218.428992:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177218.428996:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429006:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429016:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177218.429025:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:3.0:1786177218.429031:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:2.0:1786177218.429064:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145720320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177218.429087:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177218.429090:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177218.429092:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429095:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429099:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177218.429102:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177218.429111:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177218.429112:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145720320:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177218.429129:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145720448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177218.429142:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177218.429146:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177218.429148:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429153:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429158:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177218.429162:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177218.429168:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177218.429179:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177218.429183:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145720576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177218.429193:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177218.429197:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177218.429199:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429203:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429208:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177218.429215:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87d500 x1872931145720320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177218.429216:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177218.429225:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177218.429234:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145720320/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177218.429242:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145720704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177218.429245:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429254:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177218.429254:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177218.429259:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786177218.429262:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145720320:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177218.429263:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429268:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429274:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177218.429277:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177218.429280:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177218.429287:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145720832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177218.429295:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177218.429297:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145720448:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177218.429298:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177218.429302:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429308:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429310:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177218.429313:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177218.429316:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177218.429326:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145720960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177218.429334:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177218.429334:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177218.429340:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177218.429341:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429359:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429364:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177218.429365:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87c000 x1872931145720448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177218.429371:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177218.429381:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177218.429385:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145720448/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177218.429393:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429398:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177218.429399:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145721088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177218.429402:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145720448:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177218.429415:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145720576:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177218.429430:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177218.429433:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177218.429435:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429440:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429443:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177218.429449:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177218.429450:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:2.0:1786177218.429454:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177218.429465:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145721216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177218.429470:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87f100 x1872931145720576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177218.429476:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177218.429479:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177218.429480:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177218.429484:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10952
00000100:00080000:2.0:1786177218.429489:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177218.429494:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177218.429498:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177218.429500:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145720576/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177218.429508:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145721344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177218.429510:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429518:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177218.429524:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145720576:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177218.429530:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145720704:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177218.429547:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177218.429554:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87c380 x1872931145720704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177218.429561:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145720704/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177218.429567:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429569:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177218.429571:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145720704:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177218.429582:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145720832:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177218.429599:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177218.429606:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87df80 x1872931145720832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177218.429613:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145720832/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177218.429618:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429620:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177218.429622:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145720832:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177218.429626:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145720960:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177218.429635:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177218.429641:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87f800 x1872931145720960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177218.429648:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145720960/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177218.429653:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429655:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177218.429657:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145720960:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177218.429660:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145721088:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177218.429669:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177218.429675:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87d880 x1872931145721088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177218.429682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145721088/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177218.429686:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177218.429690:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145721088:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177218.429693:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145721216:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177218.429703:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177218.429708:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87ca80 x1872931145721216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177218.429714:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145721216/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177218.429719:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429720:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177218.429722:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145721216:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177218.429726:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145721344:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177218.429740:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177218.429748:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177218/real 1786177218]  req@ffff89d99e87e680 x1872931145721344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177218.429755:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145721344/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177218.429760:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177218.429762:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177218.429764:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145721344:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177218.940986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177218.941045:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177219.452977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177219.964995:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177219.965083:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177220.476949:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177220.988994:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177220.989054:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177221.500996:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177222.012986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177222.013062:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177222.525013:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177223.037027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177223.037093:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177223.549052:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177223.549072:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549083:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177223.549089:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177223.549100:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:2.0:1786177223.549113:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177223.549125:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177223.549165:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145721472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177223.549194:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549198:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177223.549200:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177223.549204:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:2.0:1786177223.549209:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177223.549213:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177223.549223:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177223.549238:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145721600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177223.549251:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549256:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00100000:1.0:1786177223.549259:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145721472:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177223.549259:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177223.549269:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:2.0:1786177223.549274:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177223.549277:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177223.549283:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177223.549313:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145721728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177223.549325:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549329:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177223.549332:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177223.549336:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:2.0:1786177223.549341:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177223.549345:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177223.549351:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177223.549364:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177223.549366:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145721856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177223.549378:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549382:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177223.549384:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177223.549388:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:2.0:1786177223.549393:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177223.549397:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177223.549403:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177223.549416:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87ed80 x1872931145721472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177223.549418:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145721984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177223.549460:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145721472/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177223.549461:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549473:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177223.549477:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177223.549480:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177223.549486:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:1.0:1786177223.549491:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177223.549494:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177223.549499:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145721472:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177223.549503:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177223.549513:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177223.549524:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145722112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177223.549532:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549536:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177223.549537:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177223.549540:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:2.0:1786177223.549543:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177223.549545:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145721600:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177223.549549:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177223.549558:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177223.549572:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145722240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177223.549582:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177223.549583:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549589:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177223.549592:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177223.549596:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87c700 x1872931145721600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177223.549600:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:2.0:1786177223.549607:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177223.549619:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177223.549622:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145721600/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177223.549625:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177223.549633:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177223.549636:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177223.549642:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145722368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177223.549643:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145721600:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177223.549655:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145721728:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177223.549658:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177223.549662:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177223.549664:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177223.549669:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10957
00000100:00080000:2.0:1786177223.549672:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177223.549676:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177223.549681:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177223.549687:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177223.549688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87dc00 x1872931145721728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177223.549700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145721728/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177223.549706:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145722496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177223.549708:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177223.549717:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177223.549725:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145721728:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177223.549745:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145721856:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177223.549773:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177223.549796:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87e680 x1872931145721856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177223.549811:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145721856/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177223.549826:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177223.549829:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177223.549832:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145721856:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177223.549837:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145721984:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177223.549852:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177223.549860:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87ca80 x1872931145721984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177223.549871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145721984/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177223.549880:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177223.549883:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177223.549887:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145721984:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177223.549942:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145722112:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177223.549966:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177223.549989:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87d880 x1872931145722112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177223.550002:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145722112/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177223.550011:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177223.550015:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177223.550019:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145722112:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177223.550026:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145722240:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177223.550055:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177223.550066:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87f800 x1872931145722240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177223.550078:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145722240/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177223.550087:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177223.550089:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177223.550093:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145722240:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177223.550099:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145722368:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177223.550131:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177223.550141:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87df80 x1872931145722368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177223.550149:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145722368/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177223.550155:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177223.550157:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177223.550159:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145722368:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177223.550163:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145722496:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177223.550175:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177223.550181:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177223/real 1786177223]  req@ffff89d99e87c380 x1872931145722496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177223.550188:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145722496/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177223.550193:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177223.550195:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177223.550197:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145722496:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177224.060965:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177224.061128:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177224.573027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177225.084985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177225.085116:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177225.597037:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177226.109022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177226.109089:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177226.621021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177227.132987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177227.133050:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177227.645035:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177228.157042:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177228.157102:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177228.668974:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177228.668979:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177228.668987:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177228.668992:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177228.669005:0:135456:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669019:0:135456:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177228.669028:0:135456:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177228.669076:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145722624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177228.669102:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177228.669105:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177228.669106:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177228.669110:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669113:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177228.669117:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177228.669127:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177228.669132:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145722624:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177228.669144:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145722752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177228.669164:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177228.669175:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177228.669177:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177228.669183:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669186:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177228.669190:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177228.669194:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177228.669206:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145722880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177228.669212:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177228.669218:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177228.669222:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177228.669224:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177228.669227:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669231:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177228.669235:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177228.669239:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177228.669259:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145723008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177228.669267:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177228.669270:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1786177228.669274:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87f100 x1872931145722624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177228.669274:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177228.669283:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669289:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177228.669292:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177228.669296:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177228.669299:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145722624/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177228.669308:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145723136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177228.669309:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177228.669317:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177228.669322:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177228.669324:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145722624:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177228.669325:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177228.669330:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177228.669333:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669335:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177228.669338:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177228.669341:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177228.669347:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145723264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177228.669353:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145722752:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177228.669356:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177228.669359:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177228.669361:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177228.669364:0:135456:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669368:0:135456:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177228.669371:0:135456:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177228.669374:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1786177228.669375:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669388:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87c000 x1872931145722752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177228.669392:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145723392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177228.669403:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145722752/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177228.669422:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177228.669427:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177228.669429:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1786177228.669430:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145722752:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177228.669438:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1786177228.669441:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145722880:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177228.669442:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177228.669451:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669456:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1786177228.669457:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177228.669464:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669467:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87d500 x1872931145722880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177228.669470:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177228.669488:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145723520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1786177228.669490:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145722880/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177228.669502:0:135456:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177228.669508:0:135456:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177228.669509:0:135456:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177228.669511:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177228.669515:0:135456:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10962
00000100:00080000:2.0:1786177228.669519:0:135456:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177228.669520:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177228.669525:0:135456:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669529:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145722880:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786177228.669531:0:135456:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177228.669542:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145723008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177228.669544:0:135456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145723648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1786177228.669574:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669591:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87c380 x1872931145723008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177228.669602:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145723008/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177228.669608:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177228.669611:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177228.669614:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145723008:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177228.669620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145723136:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177228.669639:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669649:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87df80 x1872931145723136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177228.669660:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145723136/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177228.669665:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177228.669667:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177228.669669:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145723136:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177228.669681:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145723264:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177228.669712:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669719:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87f800 x1872931145723264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177228.669727:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145723264/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177228.669732:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177228.669734:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177228.669736:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145723264:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177228.669740:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145723392:192.168.202.130@tcp:38:kworker.0
00000800:00000100:0.0:1786177228.669750:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669755:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87d880 x1872931145723392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177228.669763:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145723392/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177228.669773:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177228.669775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177228.669777:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145723392:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177228.669780:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145723520:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177228.669789:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669795:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87ca80 x1872931145723520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177228.669801:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145723520/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177228.669806:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177228.669808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177228.669811:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145723520:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177228.669818:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145723648:192.168.202.130@tcp:8:kworker.0
00000800:00000100:0.0:1786177228.669835:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177228.669862:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177228/real 1786177228]  req@ffff89d99e87e680 x1872931145723648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177228.669873:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145723648/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177228.669881:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177228.669884:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:0.0:1786177228.669887:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145723648:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177229.180996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177229.181063:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177229.693026:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177230.205049:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177230.205125:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177230.717007:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177231.229005:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177231.229134:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177231.741002:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177232.253027:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177232.253119:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177232.764977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177233.277017:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786177233.277047:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177233.788999:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177233.789003:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177233.789011:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177233.789016:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177233.789026:0:185474:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:0.0:1786177233.789036:0:185474:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177233.789043:0:185474:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177233.789087:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145723776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177233.789112:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177233.789115:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177233.789117:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177233.789120:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:0.0:1786177233.789123:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177233.789126:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177233.789135:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177233.789140:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145723776:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177233.789148:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145723904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177233.789158:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177233.789160:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177233.789162:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177233.789165:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:0.0:1786177233.789168:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177233.789173:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177233.789179:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177233.789193:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145724032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177233.789211:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177233.789223:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177233.789228:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177233.789230:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177233.789235:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:0.0:1786177233.789240:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177233.789245:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177233.789252:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f3100 x1872931145723776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177233.789253:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177233.789272:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145723776/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177233.789276:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145724160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177233.789289:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177233.789295:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177233.789296:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177233.789300:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145723776:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177233.789305:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177233.789309:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177233.789315:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:0.0:1786177233.789320:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177233.789324:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145723904:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177233.789328:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177233.789335:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177233.789348:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177233.789352:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145724288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177233.789361:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f0700 x1872931145723904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177233.789377:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177233.789383:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1786177233.789383:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145723904/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177233.789387:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177233.789398:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:1.0:1786177233.789399:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177233.789405:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177233.789406:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177233.789412:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145723904:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177233.789414:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177233.789421:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145724032:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786177233.789422:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177233.789439:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145724416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177233.789449:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177233.789451:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177233.789456:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177233.789458:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177233.789459:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f2d80 x1872931145724032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177233.789466:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:0.0:1786177233.789475:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177233.789478:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145724032/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177233.789483:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177233.789492:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177233.789493:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177233.789500:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177233.789502:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145724032:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177233.789507:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145724544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177233.789511:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145724160:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177233.789525:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177233.789528:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177233.789529:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786177233.789535:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177233.789538:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:0.0:1786177233.789544:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177233.789548:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f1180 x1872931145724160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177233.789550:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177233.789557:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177233.789569:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145724672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177233.789573:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145724160/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177233.789591:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177233.789592:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177233.789595:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177233.789601:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1786177233.789602:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145724160:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177233.789607:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177233.789615:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10968
00000100:00080000:0.0:1786177233.789620:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177233.789620:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145724288:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177233.789630:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177233.789636:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177233.789637:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177233.789648:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f2a00 x1872931145724288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177233.789656:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145724800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177233.789659:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145724288/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177233.789684:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177233.789688:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177233.789692:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145724288:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177233.789697:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145724416:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177233.789710:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177233.789716:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f0a80 x1872931145724416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177233.789723:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145724416/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177233.789733:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177233.789735:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177233.789737:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145724416:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177233.789740:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145724544:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177233.789749:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177233.789754:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f3b80 x1872931145724544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177233.789761:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145724544/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177233.789766:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177233.789768:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177233.789770:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145724544:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177233.789773:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145724672:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177233.789782:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177233.789787:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f0e00 x1872931145724672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177233.789794:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145724672/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177233.789799:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177233.789801:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177233.789803:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145724672:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177233.789812:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145724800:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177233.789822:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177233.789828:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177233/real 1786177233]  req@ffff89d9870f1500 x1872931145724800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177233.789836:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145724800/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177233.789844:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177233.789847:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177233.789851:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145724800:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177234.301018:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177234.301073:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177234.813015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177235.324986:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177235.325066:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177235.837143:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177236.349022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177236.349086:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177236.861022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177237.373030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177237.373061:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177237.884989:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177238.397101:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177238.397124:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1786177238.909021:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177238.909029:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1786177238.909033:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177238.909043:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00080000:3.0:1786177238.909051:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177238.909058:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177238.909063:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177238.909099:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64700 x1872931145724928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177238.909129:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177238.909132:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177238.909134:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177238.909137:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00080000:3.0:1786177238.909140:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177238.909143:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177238.909161:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177238.909173:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67100 x1872931145725056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177238.909181:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177238.909183:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177238.909185:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177238.909192:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00100000:1.0:1786177238.909193:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145724928:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177238.909195:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177238.909202:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177238.909207:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177238.909217:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66a00 x1872931145725184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177238.909224:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177238.909226:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177238.909227:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177238.909230:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00080000:3.0:1786177238.909233:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177238.909235:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177238.909238:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177238.909245:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65500 x1872931145725312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177238.909251:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177238.909253:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177238.909254:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177238.909257:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177238.909261:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00080000:3.0:1786177238.909263:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177238.909266:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177238.909269:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177238.909277:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe66d80 x1872931145725440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1786177238.909283:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177238.909286:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1786177238.909287:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177238.909292:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00100000:1.0:1786177238.909293:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe64700 x1872931145724928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177238.909294:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177238.909300:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177238.909306:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177238.909316:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe65f80 x1872931145725568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177238.909319:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64700 x1872931145724928/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177238.909332:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177238.909337:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:3.0:1786177238.909338:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177238.909339:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1786177238.909343:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00080000:1.0:1786177238.909347:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:3.0:1786177238.909347:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177238.909351:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177238.909354:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1786177238.909360:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe67b80 x1872931145725696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177238.909364:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145724928:192.168.202.130@tcp:250:kworker.0
00000100:00080000:3.0:1786177238.909376:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177238.909379:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1786177238.909381:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1786177238.909384:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00080000:3.0:1786177238.909386:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177238.909391:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145725056:192.168.202.130@tcp:38:kworker.0
00000100:00080000:3.0:1786177238.909399:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177238.909404:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1786177238.909413:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64380 x1872931145725824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177238.909418:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:3.0:1786177238.909429:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1786177238.909432:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1786177238.909433:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177238.909436:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe67100 x1872931145725056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1786177238.909439:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10973
00000100:00080000:3.0:1786177238.909444:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1786177238.909450:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:3.0:1786177238.909456:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177238.909461:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67100 x1872931145725056/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1786177238.909466:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99fe64000 x1872931145725952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177238.909475:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177238.909482:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177238.909486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145725056:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177238.909491:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145725184:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177238.909508:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177238.909515:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe66a00 x1872931145725184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177238.909523:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66a00 x1872931145725184/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177238.909528:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177238.909530:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177238.909532:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145725184:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177238.909536:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145725312:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177238.909547:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177238.909552:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe65500 x1872931145725312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177238.909564:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65500 x1872931145725312/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177238.909569:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177238.909571:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177238.909574:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145725312:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177238.909580:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145725440:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177238.909598:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177238.909610:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe66d80 x1872931145725440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177238.909622:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe66d80 x1872931145725440/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177238.909629:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177238.909632:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177238.909636:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145725440:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177238.909642:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145725568:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177238.909659:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177238.909670:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe65f80 x1872931145725568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177238.909682:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe65f80 x1872931145725568/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177238.909694:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177238.909696:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177238.909698:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145725568:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177238.909703:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145725696:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177238.909717:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177238.909724:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe67b80 x1872931145725696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177238.909732:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe67b80 x1872931145725696/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177238.909737:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177238.909739:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177238.909741:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145725696:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177238.909754:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145725824:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177238.909765:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177238.909771:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe64380 x1872931145725824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177238.909778:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64380 x1872931145725824/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177238.909783:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177238.909785:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177238.909788:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145725824:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177238.909791:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145725952:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177238.909801:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177238.909806:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177238/real 1786177238]  req@ffff89d99fe64000 x1872931145725952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177238.909813:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99fe64000 x1872931145725952/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177238.909819:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177238.909820:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177238.909822:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99fe64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145725952:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177239.420998:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177239.421048:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177239.933034:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177240.445022:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786177240.445034:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177240.956977:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177241.468991:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177241.469057:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177241.981022:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177242.492984:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177242.493059:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1786177243.005003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177243.516985:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177243.517066:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1786177244.029037:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177244.029046:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1786177244.029046:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177244.029053:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177244.029063:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029071:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177244.029078:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177244.029128:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145726080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177244.029154:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177244.029157:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177244.029158:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177244.029162:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029165:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177244.029169:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177244.029180:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177244.029180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145726080:192.168.202.130@tcp:250:kworker.0
00000100:00100000:0.0:1786177244.029198:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145726208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177244.029212:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177244.029216:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177244.029218:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177244.029223:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029235:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177244.029241:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000800:00000100:1.0:1786177244.029242:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000008:00100000:0.0:1786177244.029249:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177244.029261:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145726336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177244.029269:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177244.029271:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177244.029273:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177244.029276:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029279:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177244.029281:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f3480 x1872931145726080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177244.029284:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177244.029291:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177244.029303:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145726080/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177244.029305:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145726464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177244.029330:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177244.029330:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177244.029337:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177244.029339:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177244.029340:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177244.029346:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145726080:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177244.029347:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029354:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177244.029358:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177244.029361:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177244.029367:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145726592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177244.029372:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145726208:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177244.029384:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177244.029387:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177244.029389:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786177244.029394:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177244.029396:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029402:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177244.029406:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177244.029411:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177244.029411:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f2680 x1872931145726208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177244.029427:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145726720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177244.029429:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145726208/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177244.029449:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177244.029451:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177244.029453:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177244.029458:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177244.029458:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177244.029465:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145726208:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177244.029466:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029472:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177244.029476:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145726336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177244.029477:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177244.029486:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177244.029497:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145726848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177244.029504:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177244.029511:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177244.029514:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177244.029518:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177244.029518:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f1880 x1872931145726336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177244.029527:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029532:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177244.029537:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177244.029541:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145726336/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177244.029543:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177244.029554:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786177244.029558:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145726976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177244.029561:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177244.029568:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145726336:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177244.029576:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177244.029580:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145726464:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177244.029581:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177244.029585:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177244.029588:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10978
00000100:00080000:0.0:1786177244.029591:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177244.029593:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177244.029597:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177244.029606:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177244.029607:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145727104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177244.029620:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f1500 x1872931145726464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177244.029636:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145726464/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177244.029642:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177244.029644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177244.029646:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145726464:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177244.029656:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145726592:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177244.029672:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177244.029683:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f0e00 x1872931145726592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177244.029696:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145726592/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177244.029705:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177244.029708:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177244.029712:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145726592:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177244.029718:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145726720:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177244.029735:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177244.029742:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f3b80 x1872931145726720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177244.029749:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145726720/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177244.029759:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177244.029761:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177244.029763:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145726720:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177244.029766:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145726848:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177244.029775:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177244.029781:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f0a80 x1872931145726848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177244.029788:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145726848/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177244.029793:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177244.029795:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177244.029796:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145726848:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177244.029800:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145726976:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177244.029809:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177244.029815:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f2a00 x1872931145726976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177244.029822:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145726976/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177244.029827:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177244.029829:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177244.029831:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145726976:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177244.029835:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145727104:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177244.029848:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177244.029859:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177244/real 1786177244]  req@ffff89d9870f1180 x1872931145727104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177244.029871:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145727104/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177244.029880:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177244.029883:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177244.029886:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145727104:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177244.541039:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177244.541137:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177245.053010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177245.565020:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177245.565108:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177246.076998:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177246.589051:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177246.589124:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177247.101008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:2.0:1786177247.613078:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177247.613174:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786177248.125150:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177248.636996:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177248.637039:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177249.149014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177249.149031:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177249.149037:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177249.149041:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177249.149062:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00080000:0.0:1786177249.149074:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177249.149080:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177249.149114:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2d80 x1872931145727232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177249.149136:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177249.149145:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177249.149147:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177249.149154:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00080000:0.0:1786177249.149157:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177249.149160:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177249.149165:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145727232:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786177249.149168:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177249.149182:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0700 x1872931145727360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177249.149195:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177249.149198:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177249.149200:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177249.149205:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00080000:0.0:1786177249.149211:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177249.149216:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177249.149224:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177249.149228:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177249.149239:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3100 x1872931145727488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177249.149250:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177249.149254:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177249.149256:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177249.149261:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00080000:0.0:1786177249.149264:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177249.149266:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f2d80 x1872931145727232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177249.149270:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177249.149278:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177249.149288:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2d80 x1872931145727232/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1786177249.149292:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145727616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177249.149313:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1786177249.149314:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177249.149320:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1786177249.149323:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:0.0:1786177249.149324:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177249.149330:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145727232:192.168.202.130@tcp:250:kworker.0
00000100:00080000:0.0:1786177249.149331:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00080000:0.0:1786177249.149336:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177249.149340:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177249.149343:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177249.149350:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145727744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177249.149357:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145727360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177249.149358:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177249.149363:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177249.149365:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177249.149369:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00080000:0.0:1786177249.149372:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177249.149375:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177249.149379:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177249.149383:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:0.0:1786177249.149391:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145727872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177249.149397:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f0700 x1872931145727360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177249.149401:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177249.149408:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177249.149411:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177249.149418:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00100000:1.0:1786177249.149422:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0700 x1872931145727360/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177249.149423:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177249.149430:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177249.149436:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1786177249.149438:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786177249.149444:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145728000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177249.149454:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177249.149461:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145727360:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177249.149465:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177249.149469:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145727488:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177249.149471:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177249.149475:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177249.149482:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00080000:0.0:1786177249.149487:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1786177249.149488:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177249.149496:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177249.149501:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f3100 x1872931145727488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1786177249.149505:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177249.149515:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3100 x1872931145727488/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177249.149522:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1786177249.149525:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145728128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177249.149527:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177249.149534:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145727488:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177249.149545:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145727616:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177249.149551:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177249.149556:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177249.149559:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786177249.149564:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:0.0:1786177249.149568:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10983
00000100:00080000:0.0:1786177249.149573:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177249.149576:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f1180 x1872931145727616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1786177249.149579:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177249.149586:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177249.149600:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145728256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177249.149603:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145727616/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177249.149622:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177249.149627:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177249.149631:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145727616:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177249.149646:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145727744:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177249.149662:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177249.149670:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f2a00 x1872931145727744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177249.149678:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145727744/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177249.149683:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177249.149685:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177249.149687:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145727744:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177249.149701:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145727872:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177249.149720:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177249.149732:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f0a80 x1872931145727872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177249.149752:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145727872/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177249.149757:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177249.149759:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177249.149761:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145727872:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177249.149765:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145728000:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177249.149779:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177249.149786:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f3b80 x1872931145728000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177249.149802:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145728000/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177249.149807:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177249.149810:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177249.149812:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145728000:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177249.149816:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145728128:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177249.149831:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177249.149842:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f0e00 x1872931145728128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177249.149854:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145728128/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177249.149869:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177249.149872:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177249.149875:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145728128:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177249.149881:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145728256:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177249.149913:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177249.149922:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177249/real 1786177249]  req@ffff89d9870f1500 x1872931145728256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177249.149930:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145728256/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177249.149935:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177249.149937:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177249.149939:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145728256:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177249.661021:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177249.661094:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177250.172995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177250.685046:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177250.685118:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177251.197079:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177251.709041:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177251.709157:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177252.220978:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177252.733032:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177252.733107:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177253.245027:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177253.757054:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177253.757108:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177254.269048:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:0.0:1786177254.269061:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177254.269068:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1786177254.269073:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269081:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00080000:0.0:1786177254.269092:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177254.269099:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:0.0:1786177254.269153:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1880 x1872931145728384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177254.269182:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177254.269187:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177254.269189:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269193:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00080000:0.0:1786177254.269202:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177254.269207:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177254.269216:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145728384:192.168.202.130@tcp:250:kworker.0
00000008:00100000:0.0:1786177254.269217:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177254.269235:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2680 x1872931145728512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177254.269246:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177254.269249:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177254.269252:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269256:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00080000:0.0:1786177254.269262:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177254.269265:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177254.269279:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177254.269291:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3480 x1872931145728640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177254.269301:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177254.269305:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145728512:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177254.269306:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177254.269310:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269315:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00080000:0.0:1786177254.269319:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177254.269323:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177254.269329:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177254.269345:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145728640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:0.0:1786177254.269351:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1500 x1872931145728768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177254.269362:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177254.269365:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177254.269367:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269371:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00080000:0.0:1786177254.269375:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177254.269378:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177254.269384:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177254.269389:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145728768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:0.0:1786177254.269398:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0e00 x1872931145728896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177254.269409:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177254.269412:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1786177254.269414:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269421:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00100000:1.0:1786177254.269422:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145728896:192.168.202.130@tcp:8:kworker.0
00000100:00080000:0.0:1786177254.269425:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177254.269431:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177254.269437:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177254.269450:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f3b80 x1872931145729024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177254.269462:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177254.269465:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:0.0:1786177254.269467:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269471:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00080000:0.0:1786177254.269475:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177254.269478:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177254.269481:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145729024:192.168.202.130@tcp:38:kworker.0
00000008:00100000:0.0:1786177254.269485:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1786177254.269500:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f0a80 x1872931145729152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177254.269516:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177254.269519:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1786177254.269521:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269526:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00080000:0.0:1786177254.269530:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177254.269535:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145729152:192.168.202.130@tcp:38:kworker.0
00000100:00080000:0.0:1786177254.269536:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:0.0:1786177254.269544:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177254.269557:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f2a00 x1872931145729280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1786177254.269567:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1786177254.269570:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1786177254.269572:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1786177254.269576:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10988
00000100:00080000:0.0:1786177254.269579:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1786177254.269585:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177254.269585:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145729280:192.168.202.130@tcp:8:kworker.0
00000008:00100000:0.0:1786177254.269594:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1786177254.269606:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d9870f1180 x1872931145729408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177254.269624:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145729408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177254.781026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786177254.781043:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177255.293009:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177255.805012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177255.805073:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177256.317020:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177256.829043:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177256.829096:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177257.341003:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000400:00000100:1.0:1786177257.341188:0:2382:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.202.130:988
00000400:00000100:1.0:1786177257.341223:0:2382:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.202.130@tcp at host 192.168.202.130 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1786177257.341242:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786177257.341292:0:2382:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000800:00000100:1.0:1786177257.341304:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786177257.341328:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786177257.341338:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786177257.341346:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786177257.341354:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786177257.341361:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000800:00000100:1.0:1786177257.341367:0:2382:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.202.130@tcp
00000100:00100000:2.0:1786177257.341674:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f1180 x1872931145729408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.341700:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1180 x1872931145729408/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.341712:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.341717:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.341721:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145729408:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177257.341729:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f2a00 x1872931145729280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.341742:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2a00 x1872931145729280/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.341750:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.341754:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.341757:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145729280:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177257.341763:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f0a80 x1872931145729152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.341775:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0a80 x1872931145729152/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.341782:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.341786:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.341788:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145729152:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177257.341795:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f3b80 x1872931145729024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.341807:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3b80 x1872931145729024/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.341815:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.341818:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.341822:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145729024:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177257.341828:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f0e00 x1872931145728896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.341839:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f0e00 x1872931145728896/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.341845:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.341849:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.341852:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145728896:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177257.341858:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f1500 x1872931145728768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.341868:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1500 x1872931145728768/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.341875:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.341878:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.341880:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145728768:192.168.202.130@tcp:8:kworker.0
00000100:00100000:2.0:1786177257.341886:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f3480 x1872931145728640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.341952:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f3480 x1872931145728640/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.341961:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.341964:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.341968:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145728640:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177257.341985:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f2680 x1872931145728512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.341997:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f2680 x1872931145728512/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.342004:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.342008:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.342010:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145728512:192.168.202.130@tcp:38:kworker.0
00000100:00100000:2.0:1786177257.342017:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177254/real 1786177257]  req@ffff89d9870f1880 x1872931145728384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177257.342028:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d9870f1880 x1872931145728384/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177257.342035:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177257.342038:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177257.342042:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d9870f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145728384:192.168.202.130@tcp:250:kworker.0
00000100:00100000:3.0:1786177257.853030:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177257.853090:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177258.365425:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177258.877023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177258.877103:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177259.389010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177259.389332:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177259.389339:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177259.389343:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177259.389352:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10993
00000100:00080000:2.0:1786177259.389360:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177259.389367:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177259.389397:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145729536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177259.389424:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177259.389429:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177259.389430:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177259.389434:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10993
00000100:00080000:2.0:1786177259.389438:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177259.389442:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177259.389452:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177259.389464:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145729536:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177259.389466:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145729664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177259.389480:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177259.389483:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177259.389485:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177259.389489:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10993
00000100:00080000:2.0:1786177259.389493:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177259.389497:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177259.389502:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177259.389515:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145729792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177259.389525:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177259.389530:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177259.389531:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177259.389535:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177259.389540:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10993
00000100:00080000:2.0:1786177259.389545:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177259.389549:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177259.389555:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177259.389567:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145729920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177259.389576:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87dc00 x1872931145729536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177259.389577:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177259.389585:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177259.389589:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177259.389596:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10993
00000100:00080000:2.0:1786177259.389600:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177259.389605:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177259.389606:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145729536/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177259.389611:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177259.389624:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786177259.389626:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145730048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177259.389632:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177259.389640:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145729536:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177259.389642:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177259.389649:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177259.389651:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177259.389656:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10993
00000100:00080000:2.0:1786177259.389660:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177259.389664:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177259.389669:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145729664:192.168.202.130@tcp:38:kworker.0
00000008:00100000:2.0:1786177259.389670:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177259.389687:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145730176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177259.389697:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177259.389700:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177259.389704:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177259.389707:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177259.389712:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10993
00000100:00080000:2.0:1786177259.389716:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177259.389717:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87c700 x1872931145729664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177259.389723:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177259.389732:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177259.389737:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145729664/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177259.389746:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786177259.389748:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145730304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177259.389751:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177259.389754:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145729664:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177259.389763:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145729792:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177259.389771:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177259.389775:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177259.389778:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177259.389783:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10993
00000800:00000100:1.0:1786177259.389787:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177259.389789:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177259.389796:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177259.389801:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177259.389802:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87ed80 x1872931145729792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177259.389816:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145730432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177259.389827:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145729792/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177259.389842:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1786177259.389844:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177259.389846:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177259.389850:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1786177259.389851:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177259.389859:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10993
00000100:00100000:1.0:1786177259.389860:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145729792:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177259.389864:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177259.389870:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145729920:192.168.202.130@tcp:8:kworker.0
00000100:00080000:2.0:1786177259.389871:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177259.389879:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177259.389903:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145730560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177259.389933:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177259.389949:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87e680 x1872931145729920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177259.389975:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145729920/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177259.389982:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177259.389985:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177259.389988:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145729920:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177259.389994:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145730048:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177259.390012:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177259.390022:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87ca80 x1872931145730048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177259.390032:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145730048/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177259.390045:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177259.390048:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177259.390051:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145730048:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177259.390066:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145730176:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177259.390084:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177259.390095:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87d880 x1872931145730176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177259.390106:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145730176/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177259.390113:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177259.390116:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177259.390119:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145730176:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177259.390124:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145730304:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177259.390142:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177259.390152:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87f800 x1872931145730304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177259.390162:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145730304/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177259.390168:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177259.390171:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177259.390175:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145730304:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177259.390180:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145730432:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177259.390197:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177259.390206:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87df80 x1872931145730432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177259.390215:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145730432/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177259.390223:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177259.390225:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177259.390228:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145730432:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177259.390234:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145730560:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177259.390251:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177259.390260:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177259/real 1786177259]  req@ffff89d99e87c380 x1872931145730560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177259.390270:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145730560/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177259.390278:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177259.390281:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177259.390285:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145730560:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177259.901034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177259.901111:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177260.413021:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177260.924987:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177260.925135:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177261.437024:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177261.949034:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:2.0:1786177261.949072:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177262.461054:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177262.972979:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177262.973073:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177263.485114:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177263.997010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177263.997074:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1786177264.509006:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177264.509010:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177264.509016:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177264.509021:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177264.509031:0:185421:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509041:0:185421:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177264.509048:0:185421:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177264.509085:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d500 x1872931145730688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177264.509108:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177264.509112:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177264.509114:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177264.509118:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509121:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177264.509126:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177264.509136:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177264.509148:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c000 x1872931145730816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177264.509157:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177264.509160:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177264.509163:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177264.509167:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509170:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177264.509174:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177264.509178:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177264.509188:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f100 x1872931145730944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177264.509196:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145730688:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177264.509200:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177264.509204:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177264.509206:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177264.509210:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509213:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177264.509217:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177264.509222:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177264.509233:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145731072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177264.509242:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177264.509246:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177264.509247:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177264.509250:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509254:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177264.509257:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177264.509262:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1786177264.509270:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177264.509274:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145731200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177264.509284:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177264.509287:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177264.509290:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177264.509295:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509299:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177264.509302:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177264.509306:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177264.509318:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145731328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177264.509325:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87d500 x1872931145730688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177264.509329:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177264.509337:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177264.509340:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177264.509346:0:185421:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509350:0:185421:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177264.509354:0:185421:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177264.509357:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d500 x1872931145730688/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177264.509361:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177264.509374:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145731456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177264.509377:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.509386:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00080000:2.0:1786177264.509387:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177264.509392:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177264.509394:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177264.509396:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145730688:192.168.202.130@tcp:250:kworker.0
00000100:00080000:2.0:1786177264.509400:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509406:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177264.509411:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145730816:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177264.509412:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177264.509419:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177264.509431:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145731584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177264.509440:0:185421:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1786177264.509446:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177264.509446:0:185421:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177264.509449:0:185421:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177264.509455:0:185421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 10998
00000100:00080000:2.0:1786177264.509459:0:185421:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177264.509462:0:185421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:1.0:1786177264.509466:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87c000 x1872931145730816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1786177264.509468:0:185421:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1786177264.509482:0:185421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145731712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177264.509486:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c000 x1872931145730816/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177264.509502:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.509505:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177264.509509:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145730816:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177264.509533:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145730944:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177264.509552:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177264.509564:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87f100 x1872931145730944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177264.509575:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f100 x1872931145730944/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177264.509582:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.509585:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177264.509588:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145730944:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177264.509594:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145731072:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177264.509613:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177264.509624:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87c380 x1872931145731072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177264.509634:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145731072/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177264.509641:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.509644:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177264.509647:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145731072:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177264.509652:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145731200:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177264.509670:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177264.509693:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87df80 x1872931145731200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177264.509705:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145731200/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177264.509712:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.509716:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177264.509719:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145731200:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177264.509725:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145731328:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177264.509744:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177264.509754:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87f800 x1872931145731328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177264.509765:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145731328/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177264.509772:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.509775:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177264.509778:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145731328:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177264.509784:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145731456:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177264.509802:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177264.509814:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87d880 x1872931145731456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177264.509825:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145731456/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177264.509879:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.509883:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177264.509886:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145731456:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177264.509892:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145731584:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177264.509963:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177264.509976:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87ca80 x1872931145731584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177264.509987:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145731584/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177264.509995:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.509998:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177264.510002:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145731584:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177264.510009:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145731712:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177264.510032:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177264.510044:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177264/real 1786177264]  req@ffff89d99e87e680 x1872931145731712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177264.510056:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145731712/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177264.510065:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177264.510068:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177264.510071:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145731712:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177265.021047:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177265.021172:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177265.536103:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177266.045023:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177266.045087:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177266.556995:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177267.069003:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177267.069067:0:34855:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177267.581008:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:0.0:1786177268.093069:0:15681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177268.093086:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786177268.605014:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00010000:00010000:2.0:1786177269.117047:0:34856:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1786177269.117094:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00000100:00100000:1.0:1786177269.629045:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00080000:2.0:1786177269.629087:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) fa083e7d-a845-43f8-899d-22f17d07607d->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177269.629094:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1786177269.629098:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177269.629115:0:185474:0:(import.c:510:import_select_connection()) MGC192.168.202.130@tcp: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629126:0:185474:0:(import.c:589:import_select_connection()) MGC192.168.202.130@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177269.629132:0:185474:0:(import.c:624:import_select_connection()) MGC192.168.202.130@tcp: import ffff89d983170000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000100:00100000:2.0:1786177269.629166:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ed80 x1872931145731840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177269.629188:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177269.629191:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177269.629193:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177269.629197:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629200:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177269.629204:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d982cd0000: import ffff89d985c7d000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177269.629221:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177269.629227:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145731840:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177269.629239:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c700 x1872931145731968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177269.629251:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177269.629254:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177269.629256:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177269.629261:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629265:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177269.629269:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d982cd0000: import ffff89d985c7a800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177269.629274:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1786177269.629279:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:2.0:1786177269.629288:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87dc00 x1872931145732096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177269.629296:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177269.629299:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177269.629300:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177269.629303:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629306:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177269.629309:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d982cd0000: import ffff89d983171000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177269.629313:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177269.629315:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87ed80 x1872931145731840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177269.629323:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87e680 x1872931145732224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177269.629330:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5a4b06e4-2f81-48a2-a69a-9641ba162c19->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1786177269.629332:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ed80 x1872931145731840/t0(0) o250->MGC192.168.202.130@tcp@192.168.202.130@tcp:26/25 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177269.629333:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177269.629336:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177269.629341:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629345:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1786177269.629349:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983170000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1786177269.629349:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d982cd0000: import ffff89d985c11000 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177269.629353:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177269.629356:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177269.629361:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa083e7d-a845-43f8-899d-22f17d07607d:2391:1872931145731840:192.168.202.130@tcp:250:kworker.0
00000100:00100000:2.0:1786177269.629364:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87ca80 x1872931145732352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177269.629372:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177269.629374:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1786177269.629375:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177269.629378:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629380:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177269.629383:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145731968:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177269.629386:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff89d985c10800: import ffff89d982f93800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177269.629391:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1786177269.629399:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87d880 x1872931145732480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1786177269.629407:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177269.629407:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177269.629412:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery
00000100:00080000:2.0:1786177269.629414:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1786177269.629417:0:185474:0:(import.c:510:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629419:0:185474:0:(import.c:589:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177269.629421:0:185474:0:(import.c:624:import_select_connection()) lustre-MDT0001-mdc-ffff89d985c10800: import ffff89d982f91800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177269.629424:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34682930 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1786177269.629427:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87c700 x1872931145731968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1786177269.629433:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87f800 x1872931145732608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1786177269.629450:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177269.629452:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1786177269.629454:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1786177269.629455:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c700 x1872931145731968/t0(0) o38->lustre-MDT0000-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177269.629458:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629462:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1786177269.629467:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff89d985c10800: import ffff89d982f96800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177269.629473:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1786177269.629475:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177269.629481:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:2.0:1786177269.629482:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87df80 x1872931145732736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1786177269.629486:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145731968:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177269.629496:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145732096:192.168.202.130@tcp:38:kworker.0
00000100:00080000:2.0:1786177269.629509:0:185474:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1391445c-8586-45b3-abc5-d3599a30a98b->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1786177269.629512:0:185474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1786177269.629514:0:185474:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1786177269.629518:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00080000:2.0:1786177269.629521:0:185474:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: connect to NID 192.168.202.130@tcp last attempt 11003
00000100:00080000:2.0:1786177269.629527:0:185474:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1786177269.629530:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87dc00 x1872931145732096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1786177269.629534:0:185474:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff89d985c10800: import ffff89d98652c800 using connection 192.168.202.130@tcp/192.168.202.130@tcp
00000008:00100000:2.0:1786177269.629544:0:185474:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34682930 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1786177269.629546:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87dc00 x1872931145732096/t0(0) o38->lustre-MDT0001-mdc-ffff89d982cd0000@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177269.629553:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c7a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1786177269.629556:0:185474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff89d99e87c380 x1872931145732864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1786177269.629557:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177269.629564:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145732096:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177269.629573:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145732224:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177269.629587:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177269.629593:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87e680 x1872931145732224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177269.629599:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87e680 x1872931145732224/t0(0) o8->lustre-OST0000-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177269.629604:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d983171000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177269.629605:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177269.629607:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145732224:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177269.629610:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145732352:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177269.629619:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177269.629623:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87ca80 x1872931145732352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177269.629630:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87ca80 x1872931145732352/t0(0) o8->lustre-OST0001-osc-ffff89d982cd0000@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177269.629634:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d985c11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177269.629635:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177269.629637:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5a4b06e4-2f81-48a2-a69a-9641ba162c19:2391:1872931145732352:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177269.629646:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145732480:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177269.629655:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177269.629660:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87d880 x1872931145732480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177269.629665:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87d880 x1872931145732480/t0(0) o38->lustre-MDT0000-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177269.629670:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f93800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177269.629672:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177269.629673:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145732480:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177269.629676:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145732608:192.168.202.130@tcp:38:kworker.0
00000800:00000100:1.0:1786177269.629684:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177269.629688:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87f800 x1872931145732608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177269.629699:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87f800 x1872931145732608/t0(0) o38->lustre-MDT0001-mdc-ffff89d985c10800@192.168.202.130@tcp:12/10 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177269.629703:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f91800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177269.629704:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177269.629706:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145732608:192.168.202.130@tcp:38:kworker.0
00000100:00100000:1.0:1786177269.629709:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145732736:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177269.629719:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177269.629728:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87df80 x1872931145732736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177269.629739:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87df80 x1872931145732736/t0(0) o8->lustre-OST0000-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177269.629747:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d982f96800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177269.629750:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177269.629753:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145732736:192.168.202.130@tcp:8:kworker.0
00000100:00100000:1.0:1786177269.629758:0:2391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145732864:192.168.202.130@tcp:8:kworker.0
00000800:00000100:1.0:1786177269.629774:0:2391:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.202.130@tcp
00000100:00100000:1.0:1786177269.629784:0:2391:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1786177269/real 1786177269]  req@ffff89d99e87c380 x1872931145732864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1786177269.629793:0:2391:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff89d99e87c380 x1872931145732864/t0(0) o8->lustre-OST0001-osc-ffff89d985c10800@192.168.202.130@tcp:28/4 lens 520/544 e 0 to 1 dl 1786177294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1786177269.629805:0:2391:0:(import.c:65:import_set_state_nolock()) ffff89d98652c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1786177269.629808:0:2391:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.202.130@tcp failed (-110)
00000100:00100000:1.0:1786177269.629810:0:2391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89d99e87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1391445c-8586-45b3-abc5-d3599a30a98b:2391:1872931145732864:192.168.202.130@tcp:8:kworker.0
00000100:00100000:3.0:1786177270.141026:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:1.0:1786177270.141120:0:11991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177270.653015:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177271.165010:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177271.166231:0:49130:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177271.676965:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177272.189066:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177272.190229:0:6168:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177272.701580:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
00000100:00100000:3.0:1786177273.213012:0:184959:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d982c92180 going to sleep for 0 seconds
00010000:00010000:0.0:1786177273.213099:0:6167:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1786177273.725068:0:184961:0:(client.c:2702:ptlrpc_set_wait()) set ffff89d985b9e780 going to sleep for 0 seconds
Debug log: 77751 lines, 77751 kept, 0 dropped, 0 bad.